Nov 14 15:56:28 user nova-compute[75097]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75097) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 15:56:28 user nova-compute[75097]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75097) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 15:56:28 user nova-compute[75097]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75097) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 15:56:28 user nova-compute[75097]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:56:29 user nova-compute[75097]: INFO nova.virt.driver [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 15:56:29 user nova-compute[75097]: INFO nova.compute.provider_config [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Acquiring lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Acquired lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Releasing lock "singleton_lock" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Full set of CONF: {{(pid=75097) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ******************************************************************************** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Configuration options gathered from: {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ================================================================================ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] allow_resize_to_same_host      = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] arq_binding_timeout            = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] backdoor_port                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] backdoor_socket                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] block_device_allocate_retries  = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] block_device_allocate_retries_interval = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cert                           = self.pem {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute_monitors               = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] config_dir                     = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] config_drive_format            = iso9660 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] config_source                  = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] console_host                   = user {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] control_exchange               = nova {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cpu_allocation_ratio           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] daemon                         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] debug                          = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] default_access_ip_network_name = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] default_availability_zone      = nova {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] default_ephemeral_format       = ext4 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] default_green_pool_size        = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] default_schedule_zone          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] disk_allocation_ratio          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] enable_new_services            = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] enabled_ssl_apis               = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] flat_injected                  = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] force_config_drive             = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] force_raw_images               = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] graceful_shutdown_timeout      = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] heal_instance_info_cache_interval = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] host                           = user {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_build_timeout         = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_delete_interval       = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_name_template         = instance-%08x {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_usage_audit           = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_usage_audit_period    = month {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] internal_service_availability_zone = internal {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] key                            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] live_migration_retry_count     = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_config_append              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_dir                        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_file                       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_options                    = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_rotate_interval            = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_rotate_interval_type       = days {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] log_rotation_type              = none {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] long_rpc_timeout               = 1800 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] max_concurrent_builds          = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] max_concurrent_live_migrations = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] max_concurrent_snapshots       = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] max_local_block_devices        = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] max_logfile_count              = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] max_logfile_size_mb            = 200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] maximum_instance_delete_attempts = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metadata_listen                = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metadata_listen_port           = 8775 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metadata_workers               = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] migrate_max_retries            = -1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] mkisofs_cmd                    = genisoimage {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] my_ip                          = 10.0.0.210 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] network_allocate_retries       = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] osapi_compute_listen_port      = 8774 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] osapi_compute_unique_server_name_scope =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] osapi_compute_workers          = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] password_length                = 12 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] periodic_enable                = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] periodic_fuzzy_delay           = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] pointer_model                  = ps2mouse {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] preallocate_images             = none {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] publish_errors                 = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] pybasedir                      = /opt/stack/nova {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ram_allocation_ratio           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rate_limit_burst               = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rate_limit_except_level        = CRITICAL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rate_limit_interval            = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reboot_timeout                 = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reclaim_instance_interval      = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] record                         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reimage_timeout_per_gb         = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] report_interval                = 120 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rescue_timeout                 = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reserved_host_cpus             = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reserved_host_disk_mb          = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reserved_host_memory_mb        = 512 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] reserved_huge_pages            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] resize_confirm_window          = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] resize_fs_using_block_device   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] resume_guests_state_on_host_boot = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rpc_response_timeout           = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] run_external_periodic_tasks    = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] running_deleted_instance_action = reap {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] running_deleted_instance_timeout = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler_instance_sync_interval = 120 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_down_time              = 720 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] servicegroup_driver            = db {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] shelved_offload_time           = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] shelved_poll_interval          = 3600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] shutdown_timeout               = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] source_is_ipv6                 = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ssl_only                       = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] state_path                     = /opt/stack/data/nova {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] sync_power_state_interval      = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] sync_power_state_pool_size     = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] syslog_log_facility            = LOG_USER {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] tempdir                        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] timeout_nbd                    = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] transport_url                  = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] update_resources_interval      = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_cow_images                 = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_eventlog                   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_journal                    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_json                       = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_rootwrap_daemon            = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_stderr                     = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] use_syslog                     = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vcpu_pin_set                   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plugging_is_fatal          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plugging_timeout           = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] virt_mkfs                      = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] volume_usage_poll_interval     = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] watch_log_file                 = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] web                            = /usr/share/spice-html5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_concurrency.disable_process_locking = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.auth_strategy              = keystone {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.compute_link_prefix        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.dhcp_domain                = novalocal {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.enable_instance_password   = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.glance_link_prefix         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.instance_list_per_project_cells = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.list_records_by_skipping_down_cells = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.local_metadata_per_cell    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.max_limit                  = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.metadata_cache_expiration  = 15 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.neutron_default_tenant_id  = default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.use_forwarded_for          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.use_neutron_default_nets   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_dynamic_targets = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_jsonfile_path   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.backend_argument         = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.config_prefix            = cache.oslo {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.dead_timeout             = 60.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.debug_cache_backend      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.enable_retry_client      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.enable_socket_keepalive  = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.enabled                  = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.expiration_time          = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.hashclient_retry_attempts = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_dead_retry      = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_password        =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_sasl_enabled    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.memcache_username        =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.proxies                  = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.retry_attempts           = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.retry_delay              = 0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.socket_keepalive_count   = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.socket_keepalive_idle    = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.socket_keepalive_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.tls_allowed_ciphers      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.tls_cafile               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.tls_certfile             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.tls_enabled              = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cache.tls_keyfile              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.auth_section            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.auth_type               = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.cafile                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.certfile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.collect_timing          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.cross_az_attach         = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.debug                   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.endpoint_template       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.http_retries            = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.insecure                = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.keyfile                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.os_region_name          = RegionOne {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.split_loggers           = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cinder.timeout                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.cpu_dedicated_set      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.cpu_shared_set         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.image_type_exclude_list = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.resource_provider_association_refresh = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.shutdown_retry_interval = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] conductor.workers              = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] console.allowed_origins        = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] console.ssl_ciphers            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] console.ssl_minimum_version    = default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] consoleauth.token_ttl          = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.cafile                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.certfile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.collect_timing          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.connect_retries         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.connect_retry_delay     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.endpoint_override       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.insecure                = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.keyfile                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.max_version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.min_version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.region_name             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.service_name            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.service_type            = accelerator {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.split_loggers           = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.status_code_retries     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.timeout                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] cyborg.version                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.backend               = sqlalchemy {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.connection            = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.connection_debug      = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.connection_parameters =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.connection_recycle_time = 3600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.connection_trace      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.db_inc_retry_interval = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.db_max_retries        = 20 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.db_max_retry_interval = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.db_retry_interval     = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.max_overflow          = 50 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.max_pool_size         = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.max_retries           = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.mysql_wsrep_sync_wait = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.pool_timeout          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.retry_interval        = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.slave_connection      = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] database.sqlite_synchronous    = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.backend           = sqlalchemy {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.connection        = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.connection_debug  = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.connection_parameters =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.connection_recycle_time = 3600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.connection_trace  = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.db_inc_retry_interval = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.db_max_retries    = 20 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.db_max_retry_interval = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.db_retry_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.max_overflow      = 50 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.max_pool_size     = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.max_retries       = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.pool_timeout      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.retry_interval    = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.slave_connection  = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] api_database.sqlite_synchronous = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] devices.enabled_mdev_types     = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ephemeral_storage_encryption.enabled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.api_servers             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.cafile                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.certfile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.collect_timing          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.connect_retries         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.connect_retry_delay     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.debug                   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.default_trusted_certificate_ids = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.enable_certificate_validation = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.enable_rbd_download     = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.endpoint_override       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.insecure                = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.keyfile                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.max_version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.min_version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.num_retries             = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.rbd_ceph_conf           =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.rbd_connect_timeout     = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.rbd_pool                =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.rbd_user                =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.region_name             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.service_name            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.service_type            = image {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.split_loggers           = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.status_code_retries     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.timeout                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.verify_glance_signatures = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] glance.version                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] guestfs.debug                  = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.config_drive_cdrom      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.config_drive_inject_password = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.enable_remotefx         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.instances_path_share    =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.limit_cpu_features      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.use_multipath_io        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.vswitch_name            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] mks.enabled                    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] image_cache.manager_interval   = 2400 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] image_cache.precache_concurrency = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] image_cache.remove_unused_base_images = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] image_cache.subdirectory_name  = _base {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.api_max_retries         = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.api_retry_interval      = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.auth_section            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.auth_type               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.cafile                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.certfile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.collect_timing          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.conductor_group         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.connect_retries         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.connect_retry_delay     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.endpoint_override       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.insecure                = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.keyfile                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.max_version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.min_version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.peer_list               = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.region_name             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.serial_console_state_timeout = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.service_name            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.service_type            = baremetal {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.split_loggers           = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.status_code_retries     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.timeout                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ironic.version                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] key_manager.fixed_key          = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.barbican_api_version  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.barbican_endpoint     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.barbican_endpoint_type = public {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.barbican_region_name  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.cafile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.certfile              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.collect_timing        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.insecure              = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.keyfile               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.number_of_retries     = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.retry_delay           = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.send_service_user_token = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.split_loggers         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.timeout               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.verify_ssl            = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican.verify_ssl_path       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.auth_section = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.auth_type = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.cafile   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.collect_timing = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.keyfile  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] barbican_service_user.timeout  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.approle_role_id          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.approle_secret_id        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.cafile                   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.certfile                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.collect_timing           = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.insecure                 = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.keyfile                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.kv_mountpoint            = secret {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.kv_path                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.kv_version               = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.namespace                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.root_token_id            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.split_loggers            = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.ssl_ca_crt_file          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.timeout                  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.use_ssl                  = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.auth_section          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.auth_type             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.cafile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.certfile              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.collect_timing        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.connect_retries       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.connect_retry_delay   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.endpoint_override     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.insecure              = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.keyfile               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.max_version           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.min_version           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.region_name           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.service_name          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.service_type          = identity {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.split_loggers         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.status_code_retries   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.timeout               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] keystone.version               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.connection_uri         =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_mode               = custom {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: WARNING oslo_config.cfg [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_power_governor_high = performance {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_power_management   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.device_detach_attempts = 8 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.device_detach_timeout  = 20 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.disk_cachemodes        = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.disk_prefix            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.enabled_perf_events    = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.file_backed_memory     = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.gid_maps               = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.hw_disk_discard        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.hw_machine_type        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_rbd_pool        = rbd {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_type            = default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.images_volume_group    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.inject_key             = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.inject_partition       = -2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.inject_password        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.iscsi_iface            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.iser_use_multipath     = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_downtime = 500 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_inbound_addr = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_scheme  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_timeout_action = abort {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_tunnelled = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: WARNING oslo_config.cfg [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 15:56:29 user nova-compute[75097]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 15:56:29 user nova-compute[75097]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 15:56:29 user nova-compute[75097]: and ``live_migration_inbound_addr`` respectively.
Nov 14 15:56:29 user nova-compute[75097]: ).  Its value may be silently ignored in the future.
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.live_migration_with_native_tls = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.max_queues             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.nfs_mount_options      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.num_pcie_ports         = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.pmem_namespaces        = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.quobyte_client_cfg     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rbd_secret_uuid        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rbd_user               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rescue_image_id        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rescue_kernel_id       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.rx_queue_size          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.smbfs_mount_options    =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.snapshot_compression   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.snapshot_image_format  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.sparse_logical_volumes = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.swtpm_enabled          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.swtpm_group            = tss {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.swtpm_user             = tss {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.sysinfo_serial         = unique {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.tb_cache_size          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.tx_queue_size          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.uid_maps               = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.use_virtio_for_bridges = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.virt_type              = kvm {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.volume_clear           = zero {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.volume_clear_size      = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.volume_use_multipath   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_cache_path   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.auth_section           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.auth_type              = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.cafile                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.certfile               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.collect_timing         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.connect_retries        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.connect_retry_delay    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.default_floating_pool  = public {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.endpoint_override      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.extension_sync_interval = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.http_retries           = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.insecure               = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.keyfile                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.max_version            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.min_version            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.ovs_bridge             = br-int {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.physnets               = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.region_name            = RegionOne {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.service_metadata_proxy = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.service_name           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.service_type           = network {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.split_loggers          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.status_code_retries    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.timeout                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] neutron.version                = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] notifications.bdms_in_notifications = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] notifications.default_level    = INFO {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] notifications.notification_format = unversioned {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] notifications.notify_on_state_change = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] pci.alias                      = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] pci.device_spec                = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] pci.report_in_placement        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.auth_section         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.auth_type            = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.cafile               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.certfile             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.collect_timing       = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.connect_retries      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.connect_retry_delay  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.default_domain_id    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.default_domain_name  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.domain_id            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.domain_name          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.endpoint_override    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.insecure             = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.keyfile              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.max_version          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.min_version          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.password             = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.project_domain_id    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.project_domain_name  = Default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.project_id           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.project_name         = service {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.region_name          = RegionOne {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.service_name         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.service_type         = placement {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.split_loggers        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.status_code_retries  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.system_scope         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.timeout              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.trust_id             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.user_domain_id       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.user_domain_name     = Default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.user_id              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.username             = placement {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] placement.version              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.cores                    = 20 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.count_usage_from_placement = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.injected_file_content_bytes = 10240 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.injected_file_path_length = 255 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.injected_files           = 5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.instances                = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.key_pairs                = 100 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.metadata_items           = 128 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.ram                      = 51200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.recheck_quota            = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.server_group_members     = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] quota.server_groups            = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rdp.enabled                    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.image_metadata_prefilter = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.max_attempts         = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.max_placement_results = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] scheduler.workers              = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.host_subset_size = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.isolated_hosts = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.isolated_images = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.pci_in_placement = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.track_instance_changes = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metrics.required               = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metrics.weight_multiplier      = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] metrics.weight_setting         = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] serial_console.enabled         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] serial_console.port_range      = 10000:20000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] serial_console.serialproxy_port = 6083 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.auth_section      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.auth_type         = password {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.cafile            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.certfile          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.collect_timing    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.insecure          = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.keyfile           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.send_service_user_token = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.split_loggers     = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] service_user.timeout           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.agent_enabled            = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.enabled                  = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.html5proxy_port          = 6082 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.image_compression        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.jpeg_compression         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.playback_compression     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.server_listen            = 127.0.0.1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.streaming_mode           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] spice.zlib_compression         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] upgrade_levels.baseapi         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] upgrade_levels.cert            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] upgrade_levels.compute         = auto {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] upgrade_levels.conductor       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] upgrade_levels.scheduler       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.cafile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.certfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.insecure = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vendordata_dynamic_auth.timeout = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.api_retry_count         = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.ca_file                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.cache_prefix            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.cluster_name            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.connection_pool_size    = 10 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.console_delay_seconds   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.datastore_regex         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.host_ip                 = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.host_password           = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.host_port               = 443 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.host_username           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.insecure                = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.integration_bridge      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.maximum_objects         = 100 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.pbm_default_policy      = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.pbm_enabled             = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.pbm_wsdl_location       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.serial_port_proxy_uri   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.serial_port_service_uri = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.task_poll_interval      = 0.5 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.use_linked_clone        = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.vnc_keymap              = en-us {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.vnc_port                = 5900 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vmware.vnc_port_total          = 10000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.auth_schemes               = ['none'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.enabled                    = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.novncproxy_port            = 6080 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.vencrypt_ca_certs          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.vencrypt_client_cert       = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vnc.vencrypt_client_key        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.disable_rootwrap   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.enable_numa_live_migration = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.libvirt_disable_apic = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.client_socket_timeout     = 900 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.default_pool_size         = 1000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.keep_alive                = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.max_header_line           = 16384 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.ssl_ca_file               = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.ssl_cert_file             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.ssl_key_file              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.tcp_keepidle              = 600 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] zvm.ca_file                    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] zvm.cloud_connector_url        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] zvm.reachable_timeout          = 300 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.enforce_new_defaults = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.enforce_scope      = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.policy_default_rule = default {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.connection_string     = messaging:// {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.enabled               = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.es_doc_type           = notification {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.es_scroll_size        = 10000 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.es_scroll_time        = 2m {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.filter_error_trace    = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.hmac_keys             = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.sentinel_service_name = mymaster {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.socket_timeout        = 0.1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.trace_requests        = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler.trace_sqlalchemy      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler_jaeger.process_tags   = {} {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler_jaeger.service_name_prefix = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] profiler_otlp.service_name_prefix = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] remote_debug.host              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] remote_debug.port              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_notifications.retry = -1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.auth_section        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.auth_type           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.cafile              = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.certfile            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.collect_timing      = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.connect_retries     = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.connect_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.endpoint_id         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.endpoint_override   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.insecure            = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.keyfile             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.max_version         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.min_version         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.region_name         = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.service_name        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.service_type        = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.split_loggers       = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.status_code_retries = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.status_code_retry_delay = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.timeout             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.valid_interfaces    = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_limit.version             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_reports.file_event_handler = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] oslo_reports.log_dir           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_ovs_privileged.group  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] vif_plug_ovs_privileged.user   = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.isolate_vif         = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] os_brick.lock_path             = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] privsep_osbrick.capabilities   = [21] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] privsep_osbrick.group          = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] privsep_osbrick.helper_command = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] privsep_osbrick.user           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] nova_sys_admin.group           = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] nova_sys_admin.helper_command  = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] nova_sys_admin.user            = None {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG oslo_service.service [None req-be09daf3-80dd-418c-8628-b9bbfefc710a None None] ******************************************************************************** {{(pid=75097) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 15:56:29 user nova-compute[75097]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Connecting to libvirt: qemu:///system {{(pid=75097) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fafbbe63010> {{(pid=75097) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 15:56:29 user nova-compute[75097]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 15:56:29 user nova-compute[75097]: WARNING nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fafbbe63010> {{(pid=75097) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Starting native event thread {{(pid=75097) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Starting green dispatch thread {{(pid=75097) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Starting connection event dispatch thread {{(pid=75097) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 15:56:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Connection event '1' reason 'None'
Nov 14 15:56:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 15:56:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.mount [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Initialising _HostMountState generation 0 {{(pid=75097) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 15:56:36 user nova-compute[75097]: INFO nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host capabilities <capabilities>
Nov 14 15:56:36 user nova-compute[75097]:   <host>
Nov 14 15:56:36 user nova-compute[75097]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 15:56:36 user nova-compute[75097]:     <cpu>
Nov 14 15:56:36 user nova-compute[75097]:       <arch>x86_64</arch>
Nov 14 15:56:36 user nova-compute[75097]:       <model>IvyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:36 user nova-compute[75097]:       <microcode version='1070'/>
Nov 14 15:56:36 user nova-compute[75097]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 15:56:36 user nova-compute[75097]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='ss'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='vmx'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='pcid'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='osxsave'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='hypervisor'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='arat'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='tsc_adjust'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='md-clear'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='stibp'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='arch-capabilities'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='ssbd'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='invtsc'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='rsba'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 15:56:36 user nova-compute[75097]:       <pages unit='KiB' size='4'/>
Nov 14 15:56:36 user nova-compute[75097]:       <pages unit='KiB' size='2048'/>
Nov 14 15:56:36 user nova-compute[75097]:     </cpu>
Nov 14 15:56:36 user nova-compute[75097]:     <power_management>
Nov 14 15:56:36 user nova-compute[75097]:       <suspend_mem/>
Nov 14 15:56:36 user nova-compute[75097]:       <suspend_disk/>
Nov 14 15:56:36 user nova-compute[75097]:       <suspend_hybrid/>
Nov 14 15:56:36 user nova-compute[75097]:     </power_management>
Nov 14 15:56:36 user nova-compute[75097]:     <iommu support='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     <migration_features>
Nov 14 15:56:36 user nova-compute[75097]:       <live/>
Nov 14 15:56:36 user nova-compute[75097]:       <uri_transports>
Nov 14 15:56:36 user nova-compute[75097]:         <uri_transport>tcp</uri_transport>
Nov 14 15:56:36 user nova-compute[75097]:         <uri_transport>rdma</uri_transport>
Nov 14 15:56:36 user nova-compute[75097]:       </uri_transports>
Nov 14 15:56:36 user nova-compute[75097]:     </migration_features>
Nov 14 15:56:36 user nova-compute[75097]:     <topology>
Nov 14 15:56:36 user nova-compute[75097]:       <cells num='2'>
Nov 14 15:56:36 user nova-compute[75097]:         <cell id='0'>
Nov 14 15:56:36 user nova-compute[75097]:           <memory unit='KiB'>8140616</memory>
Nov 14 15:56:36 user nova-compute[75097]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 15:56:36 user nova-compute[75097]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 15:56:36 user nova-compute[75097]:           <distances>
Nov 14 15:56:36 user nova-compute[75097]:             <sibling id='0' value='10'/>
Nov 14 15:56:36 user nova-compute[75097]:             <sibling id='1' value='20'/>
Nov 14 15:56:36 user nova-compute[75097]:           </distances>
Nov 14 15:56:36 user nova-compute[75097]:           <cpus num='6'>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 15:56:36 user nova-compute[75097]:           </cpus>
Nov 14 15:56:36 user nova-compute[75097]:         </cell>
Nov 14 15:56:36 user nova-compute[75097]:         <cell id='1'>
Nov 14 15:56:36 user nova-compute[75097]:           <memory unit='KiB'>8255068</memory>
Nov 14 15:56:36 user nova-compute[75097]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 14 15:56:36 user nova-compute[75097]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 15:56:36 user nova-compute[75097]:           <distances>
Nov 14 15:56:36 user nova-compute[75097]:             <sibling id='0' value='20'/>
Nov 14 15:56:36 user nova-compute[75097]:             <sibling id='1' value='10'/>
Nov 14 15:56:36 user nova-compute[75097]:           </distances>
Nov 14 15:56:36 user nova-compute[75097]:           <cpus num='6'>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 15:56:36 user nova-compute[75097]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 15:56:36 user nova-compute[75097]:           </cpus>
Nov 14 15:56:36 user nova-compute[75097]:         </cell>
Nov 14 15:56:36 user nova-compute[75097]:       </cells>
Nov 14 15:56:36 user nova-compute[75097]:     </topology>
Nov 14 15:56:36 user nova-compute[75097]:     <cache>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 15:56:36 user nova-compute[75097]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 15:56:36 user nova-compute[75097]:     </cache>
Nov 14 15:56:36 user nova-compute[75097]:     <secmodel>
Nov 14 15:56:36 user nova-compute[75097]:       <model>apparmor</model>
Nov 14 15:56:36 user nova-compute[75097]:       <doi>0</doi>
Nov 14 15:56:36 user nova-compute[75097]:     </secmodel>
Nov 14 15:56:36 user nova-compute[75097]:     <secmodel>
Nov 14 15:56:36 user nova-compute[75097]:       <model>dac</model>
Nov 14 15:56:36 user nova-compute[75097]:       <doi>0</doi>
Nov 14 15:56:36 user nova-compute[75097]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 15:56:36 user nova-compute[75097]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 15:56:36 user nova-compute[75097]:     </secmodel>
Nov 14 15:56:36 user nova-compute[75097]:   </host>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='alpha'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>clipper</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='armv6l'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>spitz</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>nuri</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>kzm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sx1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>z2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>tosa</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>n810</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>n800</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>terrier</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>midway</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>microbit</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>verdex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>highbank</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>akita</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>connex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>collie</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='armv7l'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>spitz</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>nuri</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>kzm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sx1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>z2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>tosa</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>n810</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>n800</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>terrier</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>midway</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>microbit</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>verdex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>highbank</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>akita</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>connex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>collie</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='aarch64'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>spitz</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>nuri</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>kzm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sx1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>z2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>tosa</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>n810</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>n800</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>terrier</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>midway</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>microbit</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>verdex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>highbank</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>akita</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>connex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>collie</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <acpi default='on' toggle='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='cris'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='i686'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>isapc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>microvm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='kvm'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <pae/>
Nov 14 15:56:36 user nova-compute[75097]:       <nonpae/>
Nov 14 15:56:36 user nova-compute[75097]:       <acpi default='on' toggle='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:       <apic default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='m68k'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>an5206</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>q800</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='microblaze'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='microblazeel'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='mips'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='16'>malta</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='mipsel'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='16'>malta</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='mips64'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='16'>malta</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>pica61</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>magnum</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='mips64el'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='16'>malta</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>pica61</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>magnum</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='16'>boston</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='ppc'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mac99</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>40p</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>taihu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='ppc64'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>taihu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>40p</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mac99</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='ppc64le'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>taihu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>40p</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>mac99</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='riscv32'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='8'>spike</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='8'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='riscv64'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='8'>spike</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='8'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='s390x'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='sh4'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>shix</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>r2d</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='sh4eb'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>shix</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>r2d</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='sparc'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>LX</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='sparc64'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>niagara</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='x86_64'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>64</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='1'>isapc</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>microvm</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='kvm'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <acpi default='on' toggle='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:       <apic default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='xtensa'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>sim</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>kc705</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ml605</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx200</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx60</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]:   <guest>
Nov 14 15:56:36 user nova-compute[75097]:     <os_type>hvm</os_type>
Nov 14 15:56:36 user nova-compute[75097]:     <arch name='xtensaeb'>
Nov 14 15:56:36 user nova-compute[75097]:       <wordsize>32</wordsize>
Nov 14 15:56:36 user nova-compute[75097]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='4'>sim</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>kc705</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ml605</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>virt</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx200</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>lx60</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 15:56:36 user nova-compute[75097]:       <domain type='qemu'/>
Nov 14 15:56:36 user nova-compute[75097]:     </arch>
Nov 14 15:56:36 user nova-compute[75097]:     <features>
Nov 14 15:56:36 user nova-compute[75097]:       <cpuselection/>
Nov 14 15:56:36 user nova-compute[75097]:       <deviceboot/>
Nov 14 15:56:36 user nova-compute[75097]:       <disksnapshot default='on' toggle='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     </features>
Nov 14 15:56:36 user nova-compute[75097]:   </guest>
Nov 14 15:56:36 user nova-compute[75097]: </capabilities>
Nov 14 15:56:36 user nova-compute[75097]: 
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 15:56:36 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:36 user nova-compute[75097]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 15:56:36 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:36 user nova-compute[75097]:   <machine>pc-q35-jammy</machine>
Nov 14 15:56:36 user nova-compute[75097]:   <arch>i686</arch>
Nov 14 15:56:36 user nova-compute[75097]:   <vcpu max='288'/>
Nov 14 15:56:36 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:     <enum name='firmware'/>
Nov 14 15:56:36 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </loader>
Nov 14 15:56:36 user nova-compute[75097]:   </os>
Nov 14 15:56:36 user nova-compute[75097]:   <cpu>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='disable' name='lm'/>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>kvm64</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>core2duo</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Westmere</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Penryn</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G1</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Nehalem</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Conroe</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:   </cpu>
Nov 14 15:56:36 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:36 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:36 user nova-compute[75097]:     </enum>
Nov 14 15:56:36 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:36 user nova-compute[75097]:   <devices>
Nov 14 15:56:36 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </disk>
Nov 14 15:56:36 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </graphics>
Nov 14 15:56:36 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </video>
Nov 14 15:56:36 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:36 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:36 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </rng>
Nov 14 15:56:36 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:36 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </tpm>
Nov 14 15:56:36 user nova-compute[75097]:   </devices>
Nov 14 15:56:36 user nova-compute[75097]:   <features>
Nov 14 15:56:36 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:36 user nova-compute[75097]:   </features>
Nov 14 15:56:36 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:36 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 15:56:36 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:36 user nova-compute[75097]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 15:56:36 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:36 user nova-compute[75097]:   <machine>pc-i440fx-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:   <arch>i686</arch>
Nov 14 15:56:36 user nova-compute[75097]:   <vcpu max='255'/>
Nov 14 15:56:36 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:     <enum name='firmware'/>
Nov 14 15:56:36 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </loader>
Nov 14 15:56:36 user nova-compute[75097]:   </os>
Nov 14 15:56:36 user nova-compute[75097]:   <cpu>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:36 user nova-compute[75097]:       <feature policy='disable' name='lm'/>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>kvm64</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>core2duo</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Westmere</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Penryn</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Opteron_G1</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Nehalem</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Conroe</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:36 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:36 user nova-compute[75097]:     </mode>
Nov 14 15:56:36 user nova-compute[75097]:   </cpu>
Nov 14 15:56:36 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:36 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:36 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:36 user nova-compute[75097]:     </enum>
Nov 14 15:56:36 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:36 user nova-compute[75097]:   <devices>
Nov 14 15:56:36 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>ide</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </disk>
Nov 14 15:56:36 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </graphics>
Nov 14 15:56:36 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </video>
Nov 14 15:56:36 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:36 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:36 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </rng>
Nov 14 15:56:36 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:36 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:36 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:36 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:36 user nova-compute[75097]:       </enum>
Nov 14 15:56:36 user nova-compute[75097]:     </tpm>
Nov 14 15:56:36 user nova-compute[75097]:   </devices>
Nov 14 15:56:36 user nova-compute[75097]:   <features>
Nov 14 15:56:36 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:36 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:36 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:36 user nova-compute[75097]:   </features>
Nov 14 15:56:36 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:36 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 15:56:36 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:36 user nova-compute[75097]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 15:56:36 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:36 user nova-compute[75097]:   <machine>pc-q35-6.2</machine>
Nov 14 15:56:36 user nova-compute[75097]:   <arch>i686</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <vcpu max='288'/>
Nov 14 15:56:37 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='firmware'/>
Nov 14 15:56:37 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </loader>
Nov 14 15:56:37 user nova-compute[75097]:   </os>
Nov 14 15:56:37 user nova-compute[75097]:   <cpu>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='lm'/>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>kvm64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>core2duo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Westmere</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Penryn</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G1</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Conroe</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:   </cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:37 user nova-compute[75097]:   <devices>
Nov 14 15:56:37 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </disk>
Nov 14 15:56:37 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </graphics>
Nov 14 15:56:37 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </video>
Nov 14 15:56:37 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:37 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:37 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </rng>
Nov 14 15:56:37 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:37 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </tpm>
Nov 14 15:56:37 user nova-compute[75097]:   </devices>
Nov 14 15:56:37 user nova-compute[75097]:   <features>
Nov 14 15:56:37 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:   </features>
Nov 14 15:56:37 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 15:56:37 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 15:56:37 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:37 user nova-compute[75097]:   <machine>pc-i440fx-jammy</machine>
Nov 14 15:56:37 user nova-compute[75097]:   <arch>i686</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <vcpu max='255'/>
Nov 14 15:56:37 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='firmware'/>
Nov 14 15:56:37 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </loader>
Nov 14 15:56:37 user nova-compute[75097]:   </os>
Nov 14 15:56:37 user nova-compute[75097]:   <cpu>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='lm'/>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>kvm64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>core2duo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Westmere</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Penryn</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G1</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Conroe</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:   </cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:37 user nova-compute[75097]:   <devices>
Nov 14 15:56:37 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ide</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </disk>
Nov 14 15:56:37 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </graphics>
Nov 14 15:56:37 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </video>
Nov 14 15:56:37 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:37 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:37 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </rng>
Nov 14 15:56:37 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:37 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </tpm>
Nov 14 15:56:37 user nova-compute[75097]:   </devices>
Nov 14 15:56:37 user nova-compute[75097]:   <features>
Nov 14 15:56:37 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:   </features>
Nov 14 15:56:37 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 15:56:37 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 15:56:37 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:37 user nova-compute[75097]:   <machine>pc-q35-jammy</machine>
Nov 14 15:56:37 user nova-compute[75097]:   <arch>x86_64</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <vcpu max='288'/>
Nov 14 15:56:37 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='firmware'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>efi</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </loader>
Nov 14 15:56:37 user nova-compute[75097]:   </os>
Nov 14 15:56:37 user nova-compute[75097]:   <cpu>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='invtsc'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='rsba'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>core2duo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Penryn</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Opteron_G1</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Conroe</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:   </cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:37 user nova-compute[75097]:   <devices>
Nov 14 15:56:37 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </disk>
Nov 14 15:56:37 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </graphics>
Nov 14 15:56:37 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </video>
Nov 14 15:56:37 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:37 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:37 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </rng>
Nov 14 15:56:37 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:37 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </tpm>
Nov 14 15:56:37 user nova-compute[75097]:   </devices>
Nov 14 15:56:37 user nova-compute[75097]:   <features>
Nov 14 15:56:37 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:   </features>
Nov 14 15:56:37 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 15:56:37 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 15:56:37 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:37 user nova-compute[75097]:   <machine>pc-i440fx-6.2</machine>
Nov 14 15:56:37 user nova-compute[75097]:   <arch>x86_64</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <vcpu max='255'/>
Nov 14 15:56:37 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='firmware'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>efi</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </loader>
Nov 14 15:56:37 user nova-compute[75097]:   </os>
Nov 14 15:56:37 user nova-compute[75097]:   <cpu>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='invtsc'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='rsba'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>core2duo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Penryn</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Opteron_G1</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Conroe</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:   </cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:37 user nova-compute[75097]:   <devices>
Nov 14 15:56:37 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ide</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </disk>
Nov 14 15:56:37 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </graphics>
Nov 14 15:56:37 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </video>
Nov 14 15:56:37 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:37 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:37 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </rng>
Nov 14 15:56:37 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:37 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </tpm>
Nov 14 15:56:37 user nova-compute[75097]:   </devices>
Nov 14 15:56:37 user nova-compute[75097]:   <features>
Nov 14 15:56:37 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:   </features>
Nov 14 15:56:37 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 15:56:37 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 15:56:37 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:37 user nova-compute[75097]:   <machine>pc-q35-6.2</machine>
Nov 14 15:56:37 user nova-compute[75097]:   <arch>x86_64</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <vcpu max='288'/>
Nov 14 15:56:37 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='firmware'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>efi</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </loader>
Nov 14 15:56:37 user nova-compute[75097]:   </os>
Nov 14 15:56:37 user nova-compute[75097]:   <cpu>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='invtsc'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='rsba'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>core2duo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Penryn</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Opteron_G1</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Conroe</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:   </cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:37 user nova-compute[75097]:   <devices>
Nov 14 15:56:37 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </disk>
Nov 14 15:56:37 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </graphics>
Nov 14 15:56:37 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </video>
Nov 14 15:56:37 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:37 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:37 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </rng>
Nov 14 15:56:37 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:37 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </tpm>
Nov 14 15:56:37 user nova-compute[75097]:   </devices>
Nov 14 15:56:37 user nova-compute[75097]:   <features>
Nov 14 15:56:37 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:   </features>
Nov 14 15:56:37 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 15:56:37 user nova-compute[75097]: <domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 15:56:37 user nova-compute[75097]:   <domain>kvm</domain>
Nov 14 15:56:37 user nova-compute[75097]:   <machine>pc-i440fx-jammy</machine>
Nov 14 15:56:37 user nova-compute[75097]:   <arch>x86_64</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <vcpu max='255'/>
Nov 14 15:56:37 user nova-compute[75097]:   <iothreads supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:   <os supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='firmware'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>efi</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:     <loader supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>rom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pflash</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='readonly'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>yes</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='secure'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>no</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </loader>
Nov 14 15:56:37 user nova-compute[75097]:   </os>
Nov 14 15:56:37 user nova-compute[75097]:   <cpu>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-passthrough' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='hostPassthroughMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='maximum' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='maximumMigratable'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>on</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>off</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='host-model' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ss'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='vmx'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pcid'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='hypervisor'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arat'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='umip'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='md-clear'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='invtsc'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibpb'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='ibrs'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-stibp'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='rsba'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='erms'/>
Nov 14 15:56:37 user nova-compute[75097]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:     <mode name='custom' supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>qemu64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>qemu32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>phenom</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>pentium</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>n270</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm64</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>kvm32</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>coreduo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>core2duo</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>athlon</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Westmere</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Snowridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Skylake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>SandyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Penryn</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G5</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G4</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G3</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Opteron_G2</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Opteron_G1</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>IvyBridge</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Icelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Haswell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Rome</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-Milan</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>EPYC</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Dhyana</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cooperlake</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>Conroe</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='no'>Broadwell</model>
Nov 14 15:56:37 user nova-compute[75097]:       <model usable='yes'>486</model>
Nov 14 15:56:37 user nova-compute[75097]:     </mode>
Nov 14 15:56:37 user nova-compute[75097]:   </cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <memoryBacking supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:     <enum name='sourceType'>
Nov 14 15:56:37 user nova-compute[75097]:       <value>file</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>anonymous</value>
Nov 14 15:56:37 user nova-compute[75097]:       <value>memfd</value>
Nov 14 15:56:37 user nova-compute[75097]:     </enum>
Nov 14 15:56:37 user nova-compute[75097]:   </memoryBacking>
Nov 14 15:56:37 user nova-compute[75097]:   <devices>
Nov 14 15:56:37 user nova-compute[75097]:     <disk supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='diskDevice'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>disk</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cdrom</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>floppy</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>lun</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='bus'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ide</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>fdc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sata</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </disk>
Nov 14 15:56:37 user nova-compute[75097]:     <graphics supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='type'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>sdl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vnc</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>spice</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egl-headless</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </graphics>
Nov 14 15:56:37 user nova-compute[75097]:     <video supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='modelType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>cirrus</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>vmvga</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>qxl</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>none</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>bochs</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>ramfb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </video>
Nov 14 15:56:37 user nova-compute[75097]:     <hostdev supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='mode'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>subsystem</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='startupPolicy'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>default</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>mandatory</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>requisite</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>optional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='subsysType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>usb</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>pci</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>scsi</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='capsType'/>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='pciBackend'/>
Nov 14 15:56:37 user nova-compute[75097]:     </hostdev>
Nov 14 15:56:37 user nova-compute[75097]:     <rng supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtio-non-transitional</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>random</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>egd</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>builtin</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </rng>
Nov 14 15:56:37 user nova-compute[75097]:     <filesystem supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='driverType'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>path</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>handle</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>virtiofs</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </filesystem>
Nov 14 15:56:37 user nova-compute[75097]:     <tpm supported='yes'>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='model'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-tis</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>tpm-crb</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:       <enum name='backendModel'>
Nov 14 15:56:37 user nova-compute[75097]:         <value>passthrough</value>
Nov 14 15:56:37 user nova-compute[75097]:         <value>emulator</value>
Nov 14 15:56:37 user nova-compute[75097]:       </enum>
Nov 14 15:56:37 user nova-compute[75097]:     </tpm>
Nov 14 15:56:37 user nova-compute[75097]:   </devices>
Nov 14 15:56:37 user nova-compute[75097]:   <features>
Nov 14 15:56:37 user nova-compute[75097]:     <gic supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:     <vmcoreinfo supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <genid supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backingStoreInput supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <backup supported='yes'/>
Nov 14 15:56:37 user nova-compute[75097]:     <sev supported='no'/>
Nov 14 15:56:37 user nova-compute[75097]:   </features>
Nov 14 15:56:37 user nova-compute[75097]: </domainCapabilities>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75097) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75097) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Checking secure boot support for host arch (x86_64) {{(pid=75097) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Secure Boot support detected
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] cpu compare xml: <cpu match="exact">
Nov 14 15:56:37 user nova-compute[75097]:   <model>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]: </cpu>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.virt.node [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Generated node identity 321f3c0d-b8ec-4f98-bbbb-009e84ae5816
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.virt.node [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Wrote node identity 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 to /opt/stack/data/nova/compute_id
Nov 14 15:56:37 user nova-compute[75097]: WARNING nova.compute.manager [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Compute nodes ['321f3c0d-b8ec-4f98-bbbb-009e84ae5816'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.compute.manager [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 15:56:37 user nova-compute[75097]: WARNING nova.compute.manager [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 15:56:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:56:37 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:56:37 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Hypervisor/Node resource view: name=user free_ram=10954MB free_disk=26.048500061035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:56:37 user nova-compute[75097]: WARNING nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] No compute node record for user:321f3c0d-b8ec-4f98-bbbb-009e84ae5816: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 could not be found.
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Compute node record created for user:user with uuid: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] [req-0fcc722e-a391-48c8-8eca-cc5eff09683e] Created resource provider record via placement API for resource provider with UUID 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 and name user.
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75097) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 15:56:37 user nova-compute[75097]: INFO nova.virt.libvirt.host [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] kernel doesn't support AMD SEV
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Libvirt baseline CPU <cpu>
Nov 14 15:56:37 user nova-compute[75097]:   <arch>x86_64</arch>
Nov 14 15:56:37 user nova-compute[75097]:   <model>Nehalem</model>
Nov 14 15:56:37 user nova-compute[75097]:   <vendor>Intel</vendor>
Nov 14 15:56:37 user nova-compute[75097]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 15:56:37 user nova-compute[75097]: </cpu>
Nov 14 15:56:37 user nova-compute[75097]:  {{(pid=75097) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Updated inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Updating resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 generation from 0 to 1 during operation: update_inventory {{(pid=75097) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 15:56:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:56:38 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Updating resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 generation from 1 to 2 during operation: update_traits {{(pid=75097) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 15:56:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:56:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:56:38 user nova-compute[75097]: DEBUG nova.service [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Creating RPC server for service compute {{(pid=75097) start /opt/stack/nova/nova/service.py:182}}
Nov 14 15:56:38 user nova-compute[75097]: DEBUG nova.service [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] Join ServiceGroup membership for this service compute {{(pid=75097) start /opt/stack/nova/nova/service.py:199}}
Nov 14 15:56:38 user nova-compute[75097]: DEBUG nova.servicegroup.drivers.db [None req-8983a865-bb23-4827-9f7c-47957dd65e05 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75097) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 15:57:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:57:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:57:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=10345MB free_disk=25.95232391357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:57:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:58:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:58:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:58:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=10279MB free_disk=25.972862243652344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:58:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:59:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:59:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:59:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=10269MB free_disk=25.76904296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:59:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:59:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:59:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:00:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:00:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9573MB free_disk=25.789134979248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d65d5581-f4aa-49d6-9114-4b37cf70e513 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:00:32 user nova-compute[75097]: INFO nova.compute.claims [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Claim successful on node user
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Skipping network cache update for instance because it is Building. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:00:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:00:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:00:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Creating image(s)
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "/opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "/opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "/opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG nova.policy [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3832b7c7c20a49868173a61405397932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7b1dfdadfa4f7d8ebdecc5ac2e5594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG nova.virt.images [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] 8453bef7-6457-4331-abaa-62588e201fe1 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.part /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.part /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.converted" returned: 0 in 0.247s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.468s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:34 user nova-compute[75097]: INFO oslo.privsep.daemon [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcn12n9vz/privsep.sock']
Nov 14 16:00:34 user sudo[84332]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcn12n9vz/privsep.sock
Nov 14 16:00:34 user sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Successfully created port: 6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:00:36 user sudo[84332]: pam_unix(sudo:session): session closed for user root
Nov 14 16:00:36 user nova-compute[75097]: INFO oslo.privsep.daemon [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Spawned new privsep daemon via rootwrap
Nov 14 16:00:36 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 16:00:36 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 16:00:36 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 16:00:36 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84342
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:00:36 user nova-compute[75097]: INFO nova.compute.claims [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Claim successful on node user
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk 1073741824" returned: 0 in 0.052s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "b524df86-e1ec-4255-ba03-e8a314560af9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.206s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:00:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:00:37 user nova-compute[75097]: INFO nova.compute.claims [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Claim successful on node user
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Cannot resize image /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Ensure instance console log exists: /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:00:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Creating image(s)
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "/opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "/opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.policy [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0c8e2c01a9a4defa352c3e3fcbb4f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925bff9b1de4d35bc1a0c84437c4a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.202s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:00:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk 1073741824" returned: 0 in 0.048s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:00:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Creating image(s)
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:00:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Cannot resize image /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Ensure instance console log exists: /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.policy [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d1946be4a442eb9b3bc8343510f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826e20e537274874bd3e0236eca9629f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk 1073741824" returned: 0 in 0.047s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Successfully updated port: 6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquired lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:00:38 user nova-compute[75097]: INFO nova.compute.claims [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Claim successful on node user
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Cannot resize image /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Ensure instance console log exists: /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-changed-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Refreshing instance network info cache due to event network-changed-6025f91f-dabd-4fb9-8d51-0b2a02e79206. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:00:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] Acquiring lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:00:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updating instance_info_cache with network_info: [{"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Releasing lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Instance network_info: |[{"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] Acquired lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.neutron [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Refreshing network info cache for port 6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Start _get_guest_xml network_info=[{"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:00:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1135530486',display_name='tempest-DeleteServersTestJSON-server-1135530486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1135530486',id=1,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c7b1dfdadfa4f7d8ebdecc5ac2e5594',ramdisk_id='',reservation_id='r-nvea01vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-655881871',owner_user_name='tempest-DeleteServersTestJSON-655881871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:33Z,user_data=None,user_id='3832b7c7c20a49868173a61405397932',uuid=d65d5581-f4aa-49d6-9114-4b37cf70e513,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Converting VIF {"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.objects.instance [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lazy-loading 'pci_devices' on Instance uuid d65d5581-f4aa-49d6-9114-4b37cf70e513 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.policy [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d1946be4a442eb9b3bc8343510f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826e20e537274874bd3e0236eca9629f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Successfully created port: 7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:00:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Creating image(s)
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:00:39 user nova-compute[75097]:   <uuid>d65d5581-f4aa-49d6-9114-4b37cf70e513</uuid>
Nov 14 16:00:39 user nova-compute[75097]:   <name>instance-00000001</name>
Nov 14 16:00:39 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:00:39 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:00:39 user nova-compute[75097]:   <metadata>
Nov 14 16:00:39 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:00:39 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:00:39 user nova-compute[75097]:       <nova:name>tempest-DeleteServersTestJSON-server-1135530486</nova:name>
Nov 14 16:00:39 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:00:39</nova:creationTime>
Nov 14 16:00:39 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:00:39 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:00:39 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:00:39 user nova-compute[75097]:       <nova:owner>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:user uuid="3832b7c7c20a49868173a61405397932">tempest-DeleteServersTestJSON-655881871-project-member</nova:user>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:project uuid="4c7b1dfdadfa4f7d8ebdecc5ac2e5594">tempest-DeleteServersTestJSON-655881871</nova:project>
Nov 14 16:00:39 user nova-compute[75097]:       </nova:owner>
Nov 14 16:00:39 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:00:39 user nova-compute[75097]:       <nova:ports>
Nov 14 16:00:39 user nova-compute[75097]:         <nova:port uuid="6025f91f-dabd-4fb9-8d51-0b2a02e79206">
Nov 14 16:00:39 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 16:00:39 user nova-compute[75097]:         </nova:port>
Nov 14 16:00:39 user nova-compute[75097]:       </nova:ports>
Nov 14 16:00:39 user nova-compute[75097]:     </nova:instance>
Nov 14 16:00:39 user nova-compute[75097]:   </metadata>
Nov 14 16:00:39 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:00:39 user nova-compute[75097]:     <system>
Nov 14 16:00:39 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:00:39 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:00:39 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:00:39 user nova-compute[75097]:       <entry name="serial">d65d5581-f4aa-49d6-9114-4b37cf70e513</entry>
Nov 14 16:00:39 user nova-compute[75097]:       <entry name="uuid">d65d5581-f4aa-49d6-9114-4b37cf70e513</entry>
Nov 14 16:00:39 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:00:39 user nova-compute[75097]:     </system>
Nov 14 16:00:39 user nova-compute[75097]:   </sysinfo>
Nov 14 16:00:39 user nova-compute[75097]:   <os>
Nov 14 16:00:39 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:00:39 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:00:39 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:00:39 user nova-compute[75097]:   </os>
Nov 14 16:00:39 user nova-compute[75097]:   <features>
Nov 14 16:00:39 user nova-compute[75097]:     <acpi/>
Nov 14 16:00:39 user nova-compute[75097]:     <apic/>
Nov 14 16:00:39 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:00:39 user nova-compute[75097]:   </features>
Nov 14 16:00:39 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:00:39 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:00:39 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:00:39 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:00:39 user nova-compute[75097]:   </clock>
Nov 14 16:00:39 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:00:39 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:00:39 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:00:39 user nova-compute[75097]:   </cpu>
Nov 14 16:00:39 user nova-compute[75097]:   <devices>
Nov 14 16:00:39 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:00:39 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:00:39 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk"/>
Nov 14 16:00:39 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:00:39 user nova-compute[75097]:     </disk>
Nov 14 16:00:39 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:00:39 user nova-compute[75097]:       <mac address="fa:16:3e:17:d0:b2"/>
Nov 14 16:00:39 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:39 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:00:39 user nova-compute[75097]:       <target dev="tap6025f91f-da"/>
Nov 14 16:00:39 user nova-compute[75097]:     </interface>
Nov 14 16:00:39 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:00:39 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/console.log" append="off"/>
Nov 14 16:00:39 user nova-compute[75097]:     </serial>
Nov 14 16:00:39 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:00:39 user nova-compute[75097]:     <video>
Nov 14 16:00:39 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:39 user nova-compute[75097]:     </video>
Nov 14 16:00:39 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:00:39 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:00:39 user nova-compute[75097]:     </rng>
Nov 14 16:00:39 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:00:39 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:00:39 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:00:39 user nova-compute[75097]:     </memballoon>
Nov 14 16:00:39 user nova-compute[75097]:   </devices>
Nov 14 16:00:39 user nova-compute[75097]: </domain>
Nov 14 16:00:39 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1135530486',display_name='tempest-DeleteServersTestJSON-server-1135530486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1135530486',id=1,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c7b1dfdadfa4f7d8ebdecc5ac2e5594',ramdisk_id='',reservation_id='r-nvea01vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-655881871',owner_user_name='tempest-DeleteServersTestJSON-655881871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:33Z,user_data=None,user_id='3832b7c7c20a49868173a61405397932',uuid=d65d5581-f4aa-49d6-9114-4b37cf70e513,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Converting VIF {"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG os_vif [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Created schema index Interface.name {{(pid=75097) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Created schema index Port.name {{(pid=75097) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Created schema index Bridge.name {{(pid=75097) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [POLLOUT] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d45fd19-0699-59c5-97ca-026fcad496ff', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:39 user nova-compute[75097]: INFO oslo.privsep.daemon [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpcqorfv6w/privsep.sock']
Nov 14 16:00:39 user sudo[84404]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpcqorfv6w/privsep.sock
Nov 14 16:00:39 user sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk 1073741824" returned: 0 in 0.064s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Successfully created port: bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.163s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Cannot resize image /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Ensure instance console log exists: /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.network.neutron [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updated VIF entry in instance network info cache for port 6025f91f-dabd-4fb9-8d51-0b2a02e79206. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG nova.network.neutron [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updating instance_info_cache with network_info: [{"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c18d13ee-1f3a-40aa-9476-df4f56c5847b req-9c5b39d3-497e-4bdd-9f08-2ab8ce8c2355 service nova] Releasing lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:41 user sudo[84404]: pam_unix(sudo:session): session closed for user root
Nov 14 16:00:41 user nova-compute[75097]: INFO oslo.privsep.daemon [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Spawned new privsep daemon via rootwrap
Nov 14 16:00:41 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 16:00:41 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 16:00:41 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 16:00:41 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84421
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Successfully created port: 9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6025f91f-da, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6025f91f-da, col_values=(('qos', UUID('906f8b2e-8838-40a2-9012-64cef0dc9c89')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6025f91f-da, col_values=(('external_ids', {'iface-id': '6025f91f-dabd-4fb9-8d51-0b2a02e79206', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:d0:b2', 'vm-uuid': 'd65d5581-f4aa-49d6-9114-4b37cf70e513'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:41 user nova-compute[75097]: INFO os_vif [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da')
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] No VIF found with MAC fa:16:3e:17:d0:b2, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Successfully updated port: 7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquired lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Successfully updated port: bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:00:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-changed-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Refreshing instance network info cache due to event network-changed-bfb88ebb-9839-4650-a9c3-04f44b9f3310. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-changed-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Refreshing instance network info cache due to event network-changed-7816b140-b12b-4824-9056-10cd3599d212. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] Acquiring lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updating instance_info_cache with network_info: [{"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Releasing lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Instance network_info: |[{"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] Acquired lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Refreshing network info cache for port 7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Start _get_guest_xml network_info=[{"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:00:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1549134189',display_name='tempest-ServersNegativeTestJSON-server-1549134189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1549134189',id=2,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d925bff9b1de4d35bc1a0c84437c4a88',ramdisk_id='',reservation_id='r-6wtg2cvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-912372315',owner_user_name='tempest-ServersNegativeTestJSON-912372315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:37Z,user_data=None,user_id='d0c8e2c01a9a4defa352c3e3fcbb4f8c',uuid=2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converting VIF {"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:00:42 user nova-compute[75097]:   <uuid>2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1</uuid>
Nov 14 16:00:42 user nova-compute[75097]:   <name>instance-00000002</name>
Nov 14 16:00:42 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:00:42 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:00:42 user nova-compute[75097]:   <metadata>
Nov 14 16:00:42 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:00:42 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:00:42 user nova-compute[75097]:       <nova:name>tempest-ServersNegativeTestJSON-server-1549134189</nova:name>
Nov 14 16:00:42 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:00:42</nova:creationTime>
Nov 14 16:00:42 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:00:42 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:00:42 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:00:42 user nova-compute[75097]:       <nova:owner>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:user uuid="d0c8e2c01a9a4defa352c3e3fcbb4f8c">tempest-ServersNegativeTestJSON-912372315-project-member</nova:user>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:project uuid="d925bff9b1de4d35bc1a0c84437c4a88">tempest-ServersNegativeTestJSON-912372315</nova:project>
Nov 14 16:00:42 user nova-compute[75097]:       </nova:owner>
Nov 14 16:00:42 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:00:42 user nova-compute[75097]:       <nova:ports>
Nov 14 16:00:42 user nova-compute[75097]:         <nova:port uuid="7816b140-b12b-4824-9056-10cd3599d212">
Nov 14 16:00:42 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 16:00:42 user nova-compute[75097]:         </nova:port>
Nov 14 16:00:42 user nova-compute[75097]:       </nova:ports>
Nov 14 16:00:42 user nova-compute[75097]:     </nova:instance>
Nov 14 16:00:42 user nova-compute[75097]:   </metadata>
Nov 14 16:00:42 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:00:42 user nova-compute[75097]:     <system>
Nov 14 16:00:42 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:00:42 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:00:42 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:00:42 user nova-compute[75097]:       <entry name="serial">2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1</entry>
Nov 14 16:00:42 user nova-compute[75097]:       <entry name="uuid">2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1</entry>
Nov 14 16:00:42 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:00:42 user nova-compute[75097]:     </system>
Nov 14 16:00:42 user nova-compute[75097]:   </sysinfo>
Nov 14 16:00:42 user nova-compute[75097]:   <os>
Nov 14 16:00:42 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:00:42 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:00:42 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:00:42 user nova-compute[75097]:   </os>
Nov 14 16:00:42 user nova-compute[75097]:   <features>
Nov 14 16:00:42 user nova-compute[75097]:     <acpi/>
Nov 14 16:00:42 user nova-compute[75097]:     <apic/>
Nov 14 16:00:42 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:00:42 user nova-compute[75097]:   </features>
Nov 14 16:00:42 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:00:42 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:00:42 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:00:42 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:00:42 user nova-compute[75097]:   </clock>
Nov 14 16:00:42 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:00:42 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:00:42 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:00:42 user nova-compute[75097]:   </cpu>
Nov 14 16:00:42 user nova-compute[75097]:   <devices>
Nov 14 16:00:42 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:00:42 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:00:42 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk"/>
Nov 14 16:00:42 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:00:42 user nova-compute[75097]:     </disk>
Nov 14 16:00:42 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:00:42 user nova-compute[75097]:       <mac address="fa:16:3e:e1:91:d6"/>
Nov 14 16:00:42 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:42 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:00:42 user nova-compute[75097]:       <target dev="tap7816b140-b1"/>
Nov 14 16:00:42 user nova-compute[75097]:     </interface>
Nov 14 16:00:42 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:00:42 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/console.log" append="off"/>
Nov 14 16:00:42 user nova-compute[75097]:     </serial>
Nov 14 16:00:42 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:00:42 user nova-compute[75097]:     <video>
Nov 14 16:00:42 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:42 user nova-compute[75097]:     </video>
Nov 14 16:00:42 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:00:42 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:00:42 user nova-compute[75097]:     </rng>
Nov 14 16:00:42 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:00:42 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:00:42 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:00:42 user nova-compute[75097]:     </memballoon>
Nov 14 16:00:42 user nova-compute[75097]:   </devices>
Nov 14 16:00:42 user nova-compute[75097]: </domain>
Nov 14 16:00:42 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1549134189',display_name='tempest-ServersNegativeTestJSON-server-1549134189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1549134189',id=2,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d925bff9b1de4d35bc1a0c84437c4a88',ramdisk_id='',reservation_id='r-6wtg2cvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-912372315',owner_user_name='tempest-ServersNegativeTestJSON-912372315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:37Z,user_data=None,user_id='d0c8e2c01a9a4defa352c3e3fcbb4f8c',uuid=2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converting VIF {"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG os_vif [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a050c18-4b7f-52de-9239-f455ade6bb9a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7816b140-b1, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7816b140-b1, col_values=(('qos', UUID('69aca9d2-757d-4244-980c-07aa93b20a03')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7816b140-b1, col_values=(('external_ids', {'iface-id': '7816b140-b12b-4824-9056-10cd3599d212', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:91:d6', 'vm-uuid': '2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:42 user nova-compute[75097]: INFO os_vif [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1')
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] No VIF found with MAC fa:16:3e:e1:91:d6, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance network_info: |[{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Refreshing network info cache for port bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Start _get_guest_xml network_info=[{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1146543409',display_name='tempest-ServerRescueNegativeTestJSON-server-1146543409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1146543409',id=3,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-ibox19u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:38Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=b524df86-e1ec-4255-ba03-e8a314560af9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.objects.instance [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'pci_devices' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:00:43 user nova-compute[75097]:   <uuid>b524df86-e1ec-4255-ba03-e8a314560af9</uuid>
Nov 14 16:00:43 user nova-compute[75097]:   <name>instance-00000003</name>
Nov 14 16:00:43 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:00:43 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:00:43 user nova-compute[75097]:   <metadata>
Nov 14 16:00:43 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:00:43 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:00:43 user nova-compute[75097]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1146543409</nova:name>
Nov 14 16:00:43 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:00:43</nova:creationTime>
Nov 14 16:00:43 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:00:43 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:00:43 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:00:43 user nova-compute[75097]:       <nova:owner>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:user uuid="a0d1946be4a442eb9b3bc8343510f656">tempest-ServerRescueNegativeTestJSON-2084860496-project-member</nova:user>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:project uuid="826e20e537274874bd3e0236eca9629f">tempest-ServerRescueNegativeTestJSON-2084860496</nova:project>
Nov 14 16:00:43 user nova-compute[75097]:       </nova:owner>
Nov 14 16:00:43 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:00:43 user nova-compute[75097]:       <nova:ports>
Nov 14 16:00:43 user nova-compute[75097]:         <nova:port uuid="bfb88ebb-9839-4650-a9c3-04f44b9f3310">
Nov 14 16:00:43 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:00:43 user nova-compute[75097]:         </nova:port>
Nov 14 16:00:43 user nova-compute[75097]:       </nova:ports>
Nov 14 16:00:43 user nova-compute[75097]:     </nova:instance>
Nov 14 16:00:43 user nova-compute[75097]:   </metadata>
Nov 14 16:00:43 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:00:43 user nova-compute[75097]:     <system>
Nov 14 16:00:43 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:00:43 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:00:43 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:00:43 user nova-compute[75097]:       <entry name="serial">b524df86-e1ec-4255-ba03-e8a314560af9</entry>
Nov 14 16:00:43 user nova-compute[75097]:       <entry name="uuid">b524df86-e1ec-4255-ba03-e8a314560af9</entry>
Nov 14 16:00:43 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:00:43 user nova-compute[75097]:     </system>
Nov 14 16:00:43 user nova-compute[75097]:   </sysinfo>
Nov 14 16:00:43 user nova-compute[75097]:   <os>
Nov 14 16:00:43 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:00:43 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:00:43 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:00:43 user nova-compute[75097]:   </os>
Nov 14 16:00:43 user nova-compute[75097]:   <features>
Nov 14 16:00:43 user nova-compute[75097]:     <acpi/>
Nov 14 16:00:43 user nova-compute[75097]:     <apic/>
Nov 14 16:00:43 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:00:43 user nova-compute[75097]:   </features>
Nov 14 16:00:43 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:00:43 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:00:43 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:00:43 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:00:43 user nova-compute[75097]:   </clock>
Nov 14 16:00:43 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:00:43 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:00:43 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:00:43 user nova-compute[75097]:   </cpu>
Nov 14 16:00:43 user nova-compute[75097]:   <devices>
Nov 14 16:00:43 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:00:43 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:00:43 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk"/>
Nov 14 16:00:43 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:00:43 user nova-compute[75097]:     </disk>
Nov 14 16:00:43 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:00:43 user nova-compute[75097]:       <mac address="fa:16:3e:4b:53:26"/>
Nov 14 16:00:43 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:43 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:00:43 user nova-compute[75097]:       <target dev="tapbfb88ebb-98"/>
Nov 14 16:00:43 user nova-compute[75097]:     </interface>
Nov 14 16:00:43 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:00:43 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/console.log" append="off"/>
Nov 14 16:00:43 user nova-compute[75097]:     </serial>
Nov 14 16:00:43 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:00:43 user nova-compute[75097]:     <video>
Nov 14 16:00:43 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:43 user nova-compute[75097]:     </video>
Nov 14 16:00:43 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:00:43 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:00:43 user nova-compute[75097]:     </rng>
Nov 14 16:00:43 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:00:43 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:00:43 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:00:43 user nova-compute[75097]:     </memballoon>
Nov 14 16:00:43 user nova-compute[75097]:   </devices>
Nov 14 16:00:43 user nova-compute[75097]: </domain>
Nov 14 16:00:43 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1146543409',display_name='tempest-ServerRescueNegativeTestJSON-server-1146543409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1146543409',id=3,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-ibox19u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:38Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=b524df86-e1ec-4255-ba03-e8a314560af9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG os_vif [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a19c7a5d-5784-530c-b237-b39456523db7', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Successfully updated port: 9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfb88ebb-98, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfb88ebb-98, col_values=(('qos', UUID('7e4164c4-99f9-4558-85e1-3603d8f6ea12')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfb88ebb-98, col_values=(('external_ids', {'iface-id': 'bfb88ebb-9839-4650-a9c3-04f44b9f3310', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:53:26', 'vm-uuid': 'b524df86-e1ec-4255-ba03-e8a314560af9'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: INFO os_vif [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98')
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-changed-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Refreshing instance network info cache due to event network-changed-9296ab82-d1f4-4a32-b252-c7cb9d091a30. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] Acquiring lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:4b:53:26, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:00:43 user nova-compute[75097]: INFO nova.compute.claims [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Claim successful on node user
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updated VIF entry in instance network info cache for port 7816b140-b12b-4824-9056-10cd3599d212. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updating instance_info_cache with network_info: [{"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2c12196a-b3ef-440b-b346-24b75661f2e6 req-464aef6a-03cf-4d43-a397-7c5e7fb8cefe service nova] Releasing lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance network_info: |[{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updated VIF entry in instance network info cache for port bfb88ebb-9839-4650-a9c3-04f44b9f3310. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] Acquired lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Refreshing network info cache for port 9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Start _get_guest_xml network_info=[{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:00:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5e56cd70-3b90-43ef-bb70-ec610aa3472b req-357c6130-7484-43c1-a7ed-e039bf16874b service nova] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-276102445',display_name='tempest-ServerRescueNegativeTestJSON-server-276102445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-276102445',id=4,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-j0e00lv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:39Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=f6935556-dbaa-46f3-864b-73d26c5fcbf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'pci_devices' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:00:44 user nova-compute[75097]:   <uuid>f6935556-dbaa-46f3-864b-73d26c5fcbf2</uuid>
Nov 14 16:00:44 user nova-compute[75097]:   <name>instance-00000004</name>
Nov 14 16:00:44 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:00:44 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:00:44 user nova-compute[75097]:   <metadata>
Nov 14 16:00:44 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:00:44 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:00:44 user nova-compute[75097]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-276102445</nova:name>
Nov 14 16:00:44 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:00:44</nova:creationTime>
Nov 14 16:00:44 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:00:44 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:00:44 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:00:44 user nova-compute[75097]:       <nova:owner>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:user uuid="a0d1946be4a442eb9b3bc8343510f656">tempest-ServerRescueNegativeTestJSON-2084860496-project-member</nova:user>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:project uuid="826e20e537274874bd3e0236eca9629f">tempest-ServerRescueNegativeTestJSON-2084860496</nova:project>
Nov 14 16:00:44 user nova-compute[75097]:       </nova:owner>
Nov 14 16:00:44 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:00:44 user nova-compute[75097]:       <nova:ports>
Nov 14 16:00:44 user nova-compute[75097]:         <nova:port uuid="9296ab82-d1f4-4a32-b252-c7cb9d091a30">
Nov 14 16:00:44 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 16:00:44 user nova-compute[75097]:         </nova:port>
Nov 14 16:00:44 user nova-compute[75097]:       </nova:ports>
Nov 14 16:00:44 user nova-compute[75097]:     </nova:instance>
Nov 14 16:00:44 user nova-compute[75097]:   </metadata>
Nov 14 16:00:44 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:00:44 user nova-compute[75097]:     <system>
Nov 14 16:00:44 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:00:44 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:00:44 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:00:44 user nova-compute[75097]:       <entry name="serial">f6935556-dbaa-46f3-864b-73d26c5fcbf2</entry>
Nov 14 16:00:44 user nova-compute[75097]:       <entry name="uuid">f6935556-dbaa-46f3-864b-73d26c5fcbf2</entry>
Nov 14 16:00:44 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:00:44 user nova-compute[75097]:     </system>
Nov 14 16:00:44 user nova-compute[75097]:   </sysinfo>
Nov 14 16:00:44 user nova-compute[75097]:   <os>
Nov 14 16:00:44 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:00:44 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:00:44 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:00:44 user nova-compute[75097]:   </os>
Nov 14 16:00:44 user nova-compute[75097]:   <features>
Nov 14 16:00:44 user nova-compute[75097]:     <acpi/>
Nov 14 16:00:44 user nova-compute[75097]:     <apic/>
Nov 14 16:00:44 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:00:44 user nova-compute[75097]:   </features>
Nov 14 16:00:44 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:00:44 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:00:44 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:00:44 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:00:44 user nova-compute[75097]:   </clock>
Nov 14 16:00:44 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:00:44 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:00:44 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:00:44 user nova-compute[75097]:   </cpu>
Nov 14 16:00:44 user nova-compute[75097]:   <devices>
Nov 14 16:00:44 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:00:44 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:00:44 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk"/>
Nov 14 16:00:44 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:00:44 user nova-compute[75097]:     </disk>
Nov 14 16:00:44 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:00:44 user nova-compute[75097]:       <mac address="fa:16:3e:85:3f:71"/>
Nov 14 16:00:44 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:44 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:00:44 user nova-compute[75097]:       <target dev="tap9296ab82-d1"/>
Nov 14 16:00:44 user nova-compute[75097]:     </interface>
Nov 14 16:00:44 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:00:44 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/console.log" append="off"/>
Nov 14 16:00:44 user nova-compute[75097]:     </serial>
Nov 14 16:00:44 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:00:44 user nova-compute[75097]:     <video>
Nov 14 16:00:44 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:44 user nova-compute[75097]:     </video>
Nov 14 16:00:44 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:00:44 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:00:44 user nova-compute[75097]:     </rng>
Nov 14 16:00:44 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:00:44 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:00:44 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:00:44 user nova-compute[75097]:     </memballoon>
Nov 14 16:00:44 user nova-compute[75097]:   </devices>
Nov 14 16:00:44 user nova-compute[75097]: </domain>
Nov 14 16:00:44 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-276102445',display_name='tempest-ServerRescueNegativeTestJSON-server-276102445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-276102445',id=4,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-j0e00lv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:39Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=f6935556-dbaa-46f3-864b-73d26c5fcbf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG os_vif [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68f120e4-f0fb-522a-a6af-5f3c571107dc', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9296ab82-d1, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9296ab82-d1, col_values=(('qos', UUID('83b42986-edff-4946-9ee3-a65830a5750e')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9296ab82-d1, col_values=(('external_ids', {'iface-id': '9296ab82-d1f4-4a32-b252-c7cb9d091a30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:3f:71', 'vm-uuid': 'f6935556-dbaa-46f3-864b-73d26c5fcbf2'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: INFO os_vif [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1')
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:85:3f:71, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:00:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.policy [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '257dfabc0d374fdcaf4897d360547fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301ebf075c14cee925c28d1e74b1598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:00:44 user nova-compute[75097]: INFO nova.compute.claims [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Claim successful on node user
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:00:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Creating image(s)
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk 1073741824" returned: 0 in 0.065s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:00:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.policy [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e4dbd7176043dc87e7a41a87e60098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144c5ef426074ddca799c0f312162932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:00:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Creating image(s)
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "/opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "/opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Cannot resize image /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Ensure instance console log exists: /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updated VIF entry in instance network info cache for port 9296ab82-d1f4-4a32-b252-c7cb9d091a30. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0f5ac4e5-0817-4975-9479-b70b93b0dfcd req-a0845a4f-50a1-4edb-a10b-51fdebf1164b service nova] Releasing lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.202s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk 1073741824" returned: 0 in 0.041s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Cannot resize image /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Ensure instance console log exists: /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Successfully created port: ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:46 user nova-compute[75097]: DEBUG nova.network.neutron [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Successfully created port: 665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Successfully updated port: ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-changed-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Refreshing instance network info cache due to event network-changed-ea4601d8-356b-454b-945c-c469766efbab. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:00:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Instance spawned successfully.
Nov 14 16:00:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:48 user nova-compute[75097]: INFO nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Took 15.03 seconds to spawn the instance on the hypervisor.
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Successfully updated port: 665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-changed-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Refreshing instance network info cache due to event network-changed-665262a2-60e0-4453-aa2e-2e6373bc86cf. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:00:48 user nova-compute[75097]: INFO nova.compute.manager [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Took 16.33 seconds to build instance.
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e340847a-b500-4ac8-9c37-6190390473d9 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.500s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Instance network_info: |[{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Refreshing network info cache for port ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Start _get_guest_xml network_info=[{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:00:48 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:48 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1907693086',display_name='tempest-ServerActionsTestOtherA-server-1907693086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1907693086',id=6,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-31y5w6cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'pci_devices' on Instance uuid c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:00:48 user nova-compute[75097]:   <uuid>c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3</uuid>
Nov 14 16:00:48 user nova-compute[75097]:   <name>instance-00000006</name>
Nov 14 16:00:48 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:00:48 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:00:48 user nova-compute[75097]:   <metadata>
Nov 14 16:00:48 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:00:48 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:00:48 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherA-server-1907693086</nova:name>
Nov 14 16:00:48 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:00:48</nova:creationTime>
Nov 14 16:00:48 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:00:48 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:00:48 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:00:48 user nova-compute[75097]:       <nova:owner>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:user uuid="e8e4dbd7176043dc87e7a41a87e60098">tempest-ServerActionsTestOtherA-715795194-project-member</nova:user>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:project uuid="144c5ef426074ddca799c0f312162932">tempest-ServerActionsTestOtherA-715795194</nova:project>
Nov 14 16:00:48 user nova-compute[75097]:       </nova:owner>
Nov 14 16:00:48 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:00:48 user nova-compute[75097]:       <nova:ports>
Nov 14 16:00:48 user nova-compute[75097]:         <nova:port uuid="ea4601d8-356b-454b-945c-c469766efbab">
Nov 14 16:00:48 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 16:00:48 user nova-compute[75097]:         </nova:port>
Nov 14 16:00:48 user nova-compute[75097]:       </nova:ports>
Nov 14 16:00:48 user nova-compute[75097]:     </nova:instance>
Nov 14 16:00:48 user nova-compute[75097]:   </metadata>
Nov 14 16:00:48 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:00:48 user nova-compute[75097]:     <system>
Nov 14 16:00:48 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:00:48 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:00:48 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:00:48 user nova-compute[75097]:       <entry name="serial">c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3</entry>
Nov 14 16:00:48 user nova-compute[75097]:       <entry name="uuid">c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3</entry>
Nov 14 16:00:48 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:00:48 user nova-compute[75097]:     </system>
Nov 14 16:00:48 user nova-compute[75097]:   </sysinfo>
Nov 14 16:00:48 user nova-compute[75097]:   <os>
Nov 14 16:00:48 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:00:48 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:00:48 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:00:48 user nova-compute[75097]:   </os>
Nov 14 16:00:48 user nova-compute[75097]:   <features>
Nov 14 16:00:48 user nova-compute[75097]:     <acpi/>
Nov 14 16:00:48 user nova-compute[75097]:     <apic/>
Nov 14 16:00:48 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:00:48 user nova-compute[75097]:   </features>
Nov 14 16:00:48 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:00:48 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:00:48 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:00:48 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:00:48 user nova-compute[75097]:   </clock>
Nov 14 16:00:48 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:00:48 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:00:48 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:00:48 user nova-compute[75097]:   </cpu>
Nov 14 16:00:48 user nova-compute[75097]:   <devices>
Nov 14 16:00:48 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:00:48 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:00:48 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk"/>
Nov 14 16:00:48 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:00:48 user nova-compute[75097]:     </disk>
Nov 14 16:00:48 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:00:48 user nova-compute[75097]:       <mac address="fa:16:3e:76:3a:fb"/>
Nov 14 16:00:48 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:48 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:00:48 user nova-compute[75097]:       <target dev="tapea4601d8-35"/>
Nov 14 16:00:48 user nova-compute[75097]:     </interface>
Nov 14 16:00:48 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:00:48 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/console.log" append="off"/>
Nov 14 16:00:48 user nova-compute[75097]:     </serial>
Nov 14 16:00:48 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:00:48 user nova-compute[75097]:     <video>
Nov 14 16:00:48 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:48 user nova-compute[75097]:     </video>
Nov 14 16:00:48 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:00:48 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:00:48 user nova-compute[75097]:     </rng>
Nov 14 16:00:48 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:00:48 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:00:48 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:00:48 user nova-compute[75097]:     </memballoon>
Nov 14 16:00:48 user nova-compute[75097]:   </devices>
Nov 14 16:00:48 user nova-compute[75097]: </domain>
Nov 14 16:00:48 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1907693086',display_name='tempest-ServerActionsTestOtherA-server-1907693086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1907693086',id=6,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-31y5w6cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG os_vif [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbd38ee4-48f1-5f91-9b5c-5bf70712ef0c', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea4601d8-35, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea4601d8-35, col_values=(('qos', UUID('a304398b-bbb3-4eea-aabc-3b2199685568')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea4601d8-35, col_values=(('external_ids', {'iface-id': 'ea4601d8-356b-454b-945c-c469766efbab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:3a:fb', 'vm-uuid': 'c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:48 user nova-compute[75097]: INFO os_vif [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35')
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:00:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No VIF found with MAC fa:16:3e:76:3a:fb, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.neutron [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updated VIF entry in instance network info cache for port ea4601d8-356b-454b-945c-c469766efbab. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.neutron [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-114f1871-7224-4bc9-8992-9a8bd660ef03 req-f7fa7f2c-90f9-4858-98eb-7ef4bfa10e02 service nova] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance network_info: |[{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.neutron [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Refreshing network info cache for port 665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start _get_guest_xml network_info=[{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:00:49 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:49 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.objects.instance [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'pci_devices' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:00:49 user nova-compute[75097]:   <uuid>0eaff6ee-9806-4f4b-9492-ccc8328a63e0</uuid>
Nov 14 16:00:49 user nova-compute[75097]:   <name>instance-00000005</name>
Nov 14 16:00:49 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:00:49 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:00:49 user nova-compute[75097]:   <metadata>
Nov 14 16:00:49 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:00:49 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:00:49 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherB-server-462759233</nova:name>
Nov 14 16:00:49 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:00:49</nova:creationTime>
Nov 14 16:00:49 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:00:49 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:00:49 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:00:49 user nova-compute[75097]:       <nova:owner>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:user uuid="257dfabc0d374fdcaf4897d360547fb5">tempest-ServerActionsTestOtherB-652208077-project-member</nova:user>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:project uuid="0301ebf075c14cee925c28d1e74b1598">tempest-ServerActionsTestOtherB-652208077</nova:project>
Nov 14 16:00:49 user nova-compute[75097]:       </nova:owner>
Nov 14 16:00:49 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:00:49 user nova-compute[75097]:       <nova:ports>
Nov 14 16:00:49 user nova-compute[75097]:         <nova:port uuid="665262a2-60e0-4453-aa2e-2e6373bc86cf">
Nov 14 16:00:49 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:00:49 user nova-compute[75097]:         </nova:port>
Nov 14 16:00:49 user nova-compute[75097]:       </nova:ports>
Nov 14 16:00:49 user nova-compute[75097]:     </nova:instance>
Nov 14 16:00:49 user nova-compute[75097]:   </metadata>
Nov 14 16:00:49 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:00:49 user nova-compute[75097]:     <system>
Nov 14 16:00:49 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:00:49 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:00:49 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:00:49 user nova-compute[75097]:       <entry name="serial">0eaff6ee-9806-4f4b-9492-ccc8328a63e0</entry>
Nov 14 16:00:49 user nova-compute[75097]:       <entry name="uuid">0eaff6ee-9806-4f4b-9492-ccc8328a63e0</entry>
Nov 14 16:00:49 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:00:49 user nova-compute[75097]:     </system>
Nov 14 16:00:49 user nova-compute[75097]:   </sysinfo>
Nov 14 16:00:49 user nova-compute[75097]:   <os>
Nov 14 16:00:49 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:00:49 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:00:49 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:00:49 user nova-compute[75097]:   </os>
Nov 14 16:00:49 user nova-compute[75097]:   <features>
Nov 14 16:00:49 user nova-compute[75097]:     <acpi/>
Nov 14 16:00:49 user nova-compute[75097]:     <apic/>
Nov 14 16:00:49 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:00:49 user nova-compute[75097]:   </features>
Nov 14 16:00:49 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:00:49 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:00:49 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:00:49 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:00:49 user nova-compute[75097]:   </clock>
Nov 14 16:00:49 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:00:49 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:00:49 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:00:49 user nova-compute[75097]:   </cpu>
Nov 14 16:00:49 user nova-compute[75097]:   <devices>
Nov 14 16:00:49 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:00:49 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:00:49 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk"/>
Nov 14 16:00:49 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:00:49 user nova-compute[75097]:     </disk>
Nov 14 16:00:49 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:00:49 user nova-compute[75097]:       <mac address="fa:16:3e:37:e9:7c"/>
Nov 14 16:00:49 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:49 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:00:49 user nova-compute[75097]:       <target dev="tap665262a2-60"/>
Nov 14 16:00:49 user nova-compute[75097]:     </interface>
Nov 14 16:00:49 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:00:49 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/console.log" append="off"/>
Nov 14 16:00:49 user nova-compute[75097]:     </serial>
Nov 14 16:00:49 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:00:49 user nova-compute[75097]:     <video>
Nov 14 16:00:49 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:00:49 user nova-compute[75097]:     </video>
Nov 14 16:00:49 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:00:49 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:00:49 user nova-compute[75097]:     </rng>
Nov 14 16:00:49 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:00:49 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:00:49 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:00:49 user nova-compute[75097]:     </memballoon>
Nov 14 16:00:49 user nova-compute[75097]:   </devices>
Nov 14 16:00:49 user nova-compute[75097]: </domain>
Nov 14 16:00:49 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG os_vif [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2776eec1-7aab-5007-8038-4a01b095fe57', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap665262a2-60, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap665262a2-60, col_values=(('qos', UUID('78183248-feed-47a9-8252-fc20a1992b7c')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap665262a2-60, col_values=(('external_ids', {'iface-id': '665262a2-60e0-4453-aa2e-2e6373bc86cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:e9:7c', 'vm-uuid': '0eaff6ee-9806-4f4b-9492-ccc8328a63e0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:49 user nova-compute[75097]: INFO os_vif [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60')
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:00:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No VIF found with MAC fa:16:3e:37:e9:7c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:00:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Instance spawned successfully.
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:50 user nova-compute[75097]: INFO nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Took 13.06 seconds to spawn the instance on the hypervisor.
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:00:50 user nova-compute[75097]: INFO nova.compute.manager [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Took 13.89 seconds to build instance.
Nov 14 16:00:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28865663-1db6-4abf-af86-7a49cc0b5dcb tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.007s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updated VIF entry in instance network info cache for port 665262a2-60e0-4453-aa2e-2e6373bc86cf. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3460bd61-fd6c-47c6-a7e8-761a28cb1bfe req-77a533a4-f5b4-40c8-89c3-725c1237308a service nova] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:00:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance spawned successfully.
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:00:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance spawned successfully.
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:00:50 user nova-compute[75097]: INFO nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Took 13.03 seconds to spawn the instance on the hypervisor.
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:51 user nova-compute[75097]: INFO nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Took 11.57 seconds to spawn the instance on the hypervisor.
Nov 14 16:00:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:00:51 user nova-compute[75097]: INFO nova.compute.manager [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Took 13.98 seconds to build instance.
Nov 14 16:00:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cb911270-d7ce-46ff-be1c-376288b59298 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "b524df86-e1ec-4255-ba03-e8a314560af9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.257s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:51 user nova-compute[75097]: INFO nova.compute.manager [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Took 12.80 seconds to build instance.
Nov 14 16:00:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1a1687a-a4c4-4b25-a916-f972d1756230 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.968s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:00:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:00:55 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Instance spawned successfully.
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:00:55 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance spawned successfully.
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:00:56 user nova-compute[75097]: INFO nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Took 10.43 seconds to spawn the instance on the hypervisor.
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:00:56 user nova-compute[75097]: INFO nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Took 11.31 seconds to spawn the instance on the hypervisor.
Nov 14 16:00:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:00:56 user nova-compute[75097]: INFO nova.compute.manager [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Took 12.51 seconds to build instance.
Nov 14 16:00:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-972e64e1-90d5-4db4-9083-be3799e5b861 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.635s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:56 user nova-compute[75097]: INFO nova.compute.manager [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Took 11.63 seconds to build instance.
Nov 14 16:00:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d700b761-79cf-4ada-8895-dc86a396812c tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.784s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:00:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:02 user nova-compute[75097]: INFO nova.compute.claims [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Claim successful on node user
Nov 14 16:01:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-87e60aaf-54c0-4095-9c80-82c226f9cf83 req-98466532-2c64-4de3-a55b-b3cf3ac3e102 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-87e60aaf-54c0-4095-9c80-82c226f9cf83 req-98466532-2c64-4de3-a55b-b3cf3ac3e102 service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-87e60aaf-54c0-4095-9c80-82c226f9cf83 req-98466532-2c64-4de3-a55b-b3cf3ac3e102 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-87e60aaf-54c0-4095-9c80-82c226f9cf83 req-98466532-2c64-4de3-a55b-b3cf3ac3e102 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-87e60aaf-54c0-4095-9c80-82c226f9cf83 req-98466532-2c64-4de3-a55b-b3cf3ac3e102 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:02 user nova-compute[75097]: WARNING nova.compute.manager [req-87e60aaf-54c0-4095-9c80-82c226f9cf83 req-98466532-2c64-4de3-a55b-b3cf3ac3e102 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state active and task_state None.
Nov 14 16:01:02 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.922s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.network.neutron [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.policy [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '403e6a373c874a42b09067107b75355e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f76214f6904b62b3b8987610bc22c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Creating image(s)
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "/opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "/opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "/opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.260s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.408s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk 1073741824" returned: 0 in 0.146s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.561s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:04 user nova-compute[75097]: WARNING nova.compute.manager [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state active and task_state None.
Nov 14 16:01:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] No waiting events found dispatching network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:04 user nova-compute[75097]: WARNING nova.compute.manager [req-9b80cc38-5fc6-467b-955d-72c0a3189691 req-d495aafa-ea41-4e0d-9b34-01b1b58b3ca8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received unexpected event network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab for instance with vm_state active and task_state None.
Nov 14 16:01:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.335s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Successfully created port: 6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Cannot resize image /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Ensure instance console log exists: /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG nova.network.neutron [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Successfully updated port: 6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquired lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG nova.network.neutron [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-9362dc81-c3c1-4076-afef-d7b91574bc28 req-34277e61-4aca-4a97-ba09-83978bd432d6 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9362dc81-c3c1-4076-afef-d7b91574bc28 req-34277e61-4aca-4a97-ba09-83978bd432d6 service nova] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9362dc81-c3c1-4076-afef-d7b91574bc28 req-34277e61-4aca-4a97-ba09-83978bd432d6 service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9362dc81-c3c1-4076-afef-d7b91574bc28 req-34277e61-4aca-4a97-ba09-83978bd432d6 service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-9362dc81-c3c1-4076-afef-d7b91574bc28 req-34277e61-4aca-4a97-ba09-83978bd432d6 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] No waiting events found dispatching network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:06 user nova-compute[75097]: WARNING nova.compute.manager [req-9362dc81-c3c1-4076-afef-d7b91574bc28 req-34277e61-4aca-4a97-ba09-83978bd432d6 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received unexpected event network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab for instance with vm_state active and task_state None.
Nov 14 16:01:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-changed-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Refreshing instance network info cache due to event network-changed-6be39345-f45b-4a47-828b-d81f9766c60c. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] Acquiring lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updating instance_info_cache with network_info: [{"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Releasing lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Instance network_info: |[{"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] Acquired lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.neutron [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Refreshing network info cache for port 6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Start _get_guest_xml network_info=[{"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1810072340',display_name='tempest-VolumesAdminNegativeTest-server-1810072340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1810072340',id=7,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD45p5xvf9gglXsXFfkYqYoBgeAXZ/5aYbaaY6ufZuDpHVcq1WMrs50N9/sUEF6kjGY/nYlQwsooi3Yi3kyBARNoXUP9PEJwyCYzaQmiGixTEfrB2r2BmhGe5MHf82Cg+g==',key_name='tempest-keypair-180991964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1f76214f6904b62b3b8987610bc22c5',ramdisk_id='',reservation_id='r-tu0o8sum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1445801438',owner_user_name='tempest-VolumesAdminNegativeTest-1445801438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403e6a373c874a42b09067107b75355e',uuid=34098dea-702d-454d-af5e-35b51cac9bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converting VIF {"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.objects.instance [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'pci_devices' on Instance uuid 34098dea-702d-454d-af5e-35b51cac9bbf {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:07 user nova-compute[75097]:   <uuid>34098dea-702d-454d-af5e-35b51cac9bbf</uuid>
Nov 14 16:01:07 user nova-compute[75097]:   <name>instance-00000007</name>
Nov 14 16:01:07 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:07 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:07 user nova-compute[75097]:   <metadata>
Nov 14 16:01:07 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:07 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:07 user nova-compute[75097]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1810072340</nova:name>
Nov 14 16:01:07 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:07</nova:creationTime>
Nov 14 16:01:07 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:07 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:07 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:07 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:user uuid="403e6a373c874a42b09067107b75355e">tempest-VolumesAdminNegativeTest-1445801438-project-member</nova:user>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:project uuid="d1f76214f6904b62b3b8987610bc22c5">tempest-VolumesAdminNegativeTest-1445801438</nova:project>
Nov 14 16:01:07 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:07 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:01:07 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:07 user nova-compute[75097]:         <nova:port uuid="6be39345-f45b-4a47-828b-d81f9766c60c">
Nov 14 16:01:07 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 16:01:07 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:07 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:07 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:07 user nova-compute[75097]:   </metadata>
Nov 14 16:01:07 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:07 user nova-compute[75097]:     <system>
Nov 14 16:01:07 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:07 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:07 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:07 user nova-compute[75097]:       <entry name="serial">34098dea-702d-454d-af5e-35b51cac9bbf</entry>
Nov 14 16:01:07 user nova-compute[75097]:       <entry name="uuid">34098dea-702d-454d-af5e-35b51cac9bbf</entry>
Nov 14 16:01:07 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:07 user nova-compute[75097]:     </system>
Nov 14 16:01:07 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:07 user nova-compute[75097]:   <os>
Nov 14 16:01:07 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:07 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:07 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:07 user nova-compute[75097]:   </os>
Nov 14 16:01:07 user nova-compute[75097]:   <features>
Nov 14 16:01:07 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:07 user nova-compute[75097]:     <apic/>
Nov 14 16:01:07 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:07 user nova-compute[75097]:   </features>
Nov 14 16:01:07 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:07 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:07 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:07 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:07 user nova-compute[75097]:   </clock>
Nov 14 16:01:07 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:07 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:07 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:07 user nova-compute[75097]:   </cpu>
Nov 14 16:01:07 user nova-compute[75097]:   <devices>
Nov 14 16:01:07 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:01:07 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:01:07 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk"/>
Nov 14 16:01:07 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:01:07 user nova-compute[75097]:     </disk>
Nov 14 16:01:07 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:07 user nova-compute[75097]:       <mac address="fa:16:3e:89:53:94"/>
Nov 14 16:01:07 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:07 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:07 user nova-compute[75097]:       <target dev="tap6be39345-f4"/>
Nov 14 16:01:07 user nova-compute[75097]:     </interface>
Nov 14 16:01:07 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:07 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/console.log" append="off"/>
Nov 14 16:01:07 user nova-compute[75097]:     </serial>
Nov 14 16:01:07 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:07 user nova-compute[75097]:     <video>
Nov 14 16:01:07 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:07 user nova-compute[75097]:     </video>
Nov 14 16:01:07 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:07 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:07 user nova-compute[75097]:     </rng>
Nov 14 16:01:07 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:07 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:07 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:07 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:07 user nova-compute[75097]:   </devices>
Nov 14 16:01:07 user nova-compute[75097]: </domain>
Nov 14 16:01:07 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1810072340',display_name='tempest-VolumesAdminNegativeTest-server-1810072340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1810072340',id=7,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD45p5xvf9gglXsXFfkYqYoBgeAXZ/5aYbaaY6ufZuDpHVcq1WMrs50N9/sUEF6kjGY/nYlQwsooi3Yi3kyBARNoXUP9PEJwyCYzaQmiGixTEfrB2r2BmhGe5MHf82Cg+g==',key_name='tempest-keypair-180991964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1f76214f6904b62b3b8987610bc22c5',ramdisk_id='',reservation_id='r-tu0o8sum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1445801438',owner_user_name='tempest-VolumesAdminNegativeTest-1445801438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403e6a373c874a42b09067107b75355e',uuid=34098dea-702d-454d-af5e-35b51cac9bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converting VIF {"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG os_vif [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcab63e4-50c0-51bc-93b9-c263f909f4ad', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6be39345-f4, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6be39345-f4, col_values=(('qos', UUID('bee024bf-adcf-4597-9a91-0cec59dea21e')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6be39345-f4, col_values=(('external_ids', {'iface-id': '6be39345-f45b-4a47-828b-d81f9766c60c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:53:94', 'vm-uuid': '34098dea-702d-454d-af5e-35b51cac9bbf'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:07 user nova-compute[75097]: INFO os_vif [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4')
Nov 14 16:01:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No VIF found with MAC fa:16:3e:89:53:94, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-6e26c89f-c12b-45c5-b6b6-69058d82f1a1 req-00ccd157-7653-40a5-b9e2-e3ec29545573 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6e26c89f-c12b-45c5-b6b6-69058d82f1a1 req-00ccd157-7653-40a5-b9e2-e3ec29545573 service nova] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6e26c89f-c12b-45c5-b6b6-69058d82f1a1 req-00ccd157-7653-40a5-b9e2-e3ec29545573 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6e26c89f-c12b-45c5-b6b6-69058d82f1a1 req-00ccd157-7653-40a5-b9e2-e3ec29545573 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-6e26c89f-c12b-45c5-b6b6-69058d82f1a1 req-00ccd157-7653-40a5-b9e2-e3ec29545573 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] No waiting events found dispatching network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:08 user nova-compute[75097]: WARNING nova.compute.manager [req-6e26c89f-c12b-45c5-b6b6-69058d82f1a1 req-00ccd157-7653-40a5-b9e2-e3ec29545573 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received unexpected event network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 for instance with vm_state active and task_state None.
Nov 14 16:01:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:09 user nova-compute[75097]: INFO nova.compute.claims [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Claim successful on node user
Nov 14 16:01:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updated VIF entry in instance network info cache for port 6be39345-f45b-4a47-828b-d81f9766c60c. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updating instance_info_cache with network_info: [{"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc2142c4-f0d6-4307-87fd-ff8ab7e528f5 req-6f6f91a9-22e8-47f8-a163-76e2d224d738 service nova] Releasing lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:09 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.004s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.221s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:10 user nova-compute[75097]: INFO nova.compute.claims [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Claim successful on node user
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.policy [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66cdf7473a9947eaaf1ff2ade73bf6c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589b842262349c2b6acb10fd493a684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Creating image(s)
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "/opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "/opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "/opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "557796acdab1e8977b9d34fb609b2f15ab0e2659" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "557796acdab1e8977b9d34fb609b2f15ab0e2659" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-b1c3b5fb-a001-452d-b424-9fe22addc08a req-092a71c2-ca8e-44ee-92bf-4fe0940847b0 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1c3b5fb-a001-452d-b424-9fe22addc08a req-092a71c2-ca8e-44ee-92bf-4fe0940847b0 service nova] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1c3b5fb-a001-452d-b424-9fe22addc08a req-092a71c2-ca8e-44ee-92bf-4fe0940847b0 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1c3b5fb-a001-452d-b424-9fe22addc08a req-092a71c2-ca8e-44ee-92bf-4fe0940847b0 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-b1c3b5fb-a001-452d-b424-9fe22addc08a req-092a71c2-ca8e-44ee-92bf-4fe0940847b0 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] No waiting events found dispatching network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:11 user nova-compute[75097]: WARNING nova.compute.manager [req-b1c3b5fb-a001-452d-b424-9fe22addc08a req-092a71c2-ca8e-44ee-92bf-4fe0940847b0 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received unexpected event network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 for instance with vm_state active and task_state None.
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.481s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.part --force-share --output=json" returned: 0 in 0.233s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.virt.images [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] 98d746a1-6477-46ea-bdf4-cdb4091f4e31 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.part /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Successfully created port: fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1684896-8d2a-4bf2-a4a2-8fde22ac9ec2 req-37d01023-4f96-45ac-9c56-7c92717ba605 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1684896-8d2a-4bf2-a4a2-8fde22ac9ec2 req-37d01023-4f96-45ac-9c56-7c92717ba605 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1684896-8d2a-4bf2-a4a2-8fde22ac9ec2 req-37d01023-4f96-45ac-9c56-7c92717ba605 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1684896-8d2a-4bf2-a4a2-8fde22ac9ec2 req-37d01023-4f96-45ac-9c56-7c92717ba605 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1684896-8d2a-4bf2-a4a2-8fde22ac9ec2 req-37d01023-4f96-45ac-9c56-7c92717ba605 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:11 user nova-compute[75097]: WARNING nova.compute.manager [req-f1684896-8d2a-4bf2-a4a2-8fde22ac9ec2 req-37d01023-4f96-45ac-9c56-7c92717ba605 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state None.
Nov 14 16:01:11 user nova-compute[75097]: DEBUG nova.policy [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd3123fb41464b7c87ed6f4e98f4f15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd400c4a1bdd640b5991e15193e03b737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.part /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.converted" returned: 0 in 0.375s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Creating image(s)
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "/opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "/opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.057s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "557796acdab1e8977b9d34fb609b2f15ab0e2659" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.519s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 --force-share --output=json" returned: 0 in 0.259s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "557796acdab1e8977b9d34fb609b2f15ab0e2659" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "557796acdab1e8977b9d34fb609b2f15ab0e2659" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.310s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk 1073741824" returned: 0 in 0.062s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-25bbddec-d708-4693-ae18-c94006c84869 req-8776f48e-5bec-4f0c-b6db-d3dbf7b60d3c service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-25bbddec-d708-4693-ae18-c94006c84869 req-8776f48e-5bec-4f0c-b6db-d3dbf7b60d3c service nova] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-25bbddec-d708-4693-ae18-c94006c84869 req-8776f48e-5bec-4f0c-b6db-d3dbf7b60d3c service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-25bbddec-d708-4693-ae18-c94006c84869 req-8776f48e-5bec-4f0c-b6db-d3dbf7b60d3c service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-25bbddec-d708-4693-ae18-c94006c84869 req-8776f48e-5bec-4f0c-b6db-d3dbf7b60d3c service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] No waiting events found dispatching network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:12 user nova-compute[75097]: WARNING nova.compute.manager [req-25bbddec-d708-4693-ae18-c94006c84869 req-8776f48e-5bec-4f0c-b6db-d3dbf7b60d3c service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received unexpected event network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 for instance with vm_state active and task_state None.
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 --force-share --output=json" returned: 0 in 0.333s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659,backing_fmt=raw /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659,backing_fmt=raw /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk 1073741824" returned: 0 in 0.060s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "557796acdab1e8977b9d34fb609b2f15ab0e2659" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Instance spawned successfully.
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Successfully updated port: fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquired lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.280s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 --force-share --output=json" returned: 0 in 0.229s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:13 user nova-compute[75097]: INFO nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Took 9.67 seconds to spawn the instance on the hypervisor.
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-changed-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Refreshing instance network info cache due to event network-changed-fa27e284-4304-44eb-8148-4458b4fceca2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] Acquiring lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Cannot resize image /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Ensure instance console log exists: /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:13 user nova-compute[75097]: INFO nova.compute.manager [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Took 11.48 seconds to build instance.
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-19a9815f-46b0-4d7c-ba62-3e1229689a30 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.951s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Cannot resize image /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Ensure instance console log exists: /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updating instance_info_cache with network_info: [{"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Releasing lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Instance network_info: |[{"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] Acquired lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Refreshing network info cache for port fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Start _get_guest_xml network_info=[{"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T16:00:53Z,direct_url=<?>,disk_format='qcow2',id=98d746a1-6477-46ea-bdf4-cdb4091f4e31,min_disk=0,min_ram=0,name='',owner='dd023bec815f4553911b48a5cf4233b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T16:00:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/sda', 'image_id': '98d746a1-6477-46ea-bdf4-cdb4091f4e31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:13 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:13 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T16:00:53Z,direct_url=<?>,disk_format='qcow2',id=98d746a1-6477-46ea-bdf4-cdb4091f4e31,min_disk=0,min_ram=0,name='',owner='dd023bec815f4553911b48a5cf4233b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T16:00:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-531310718',display_name='tempest-AttachSCSIVolumeTestJSON-server-531310718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-531310718',id=8,image_ref='98d746a1-6477-46ea-bdf4-cdb4091f4e31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2T7E8b7zQjsJ8sMDPaTog6XQ2CLarUONHdSA0TLB5qSAQ3VjwUrAhk0piT1ONX3jzYPAdd0xb4LQNBqpT0kCidvt2yYbhpJz/tSJ4TCMqI6XViLzmS5HPExH+5A47XBg==',key_name='tempest-keypair-1009317236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a589b842262349c2b6acb10fd493a684',ramdisk_id='',reservation_id='r-ngdosr0r',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98d746a1-6477-46ea-bdf4-cdb4091f4e31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1241104298',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1241104298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66cdf7473a9947eaaf1ff2ade73bf6c7',uuid=e693c347-3d72-43eb-9a2f-77bee3d17210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Converting VIF {"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lazy-loading 'pci_devices' on Instance uuid e693c347-3d72-43eb-9a2f-77bee3d17210 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:13 user nova-compute[75097]:   <uuid>e693c347-3d72-43eb-9a2f-77bee3d17210</uuid>
Nov 14 16:01:13 user nova-compute[75097]:   <name>instance-00000008</name>
Nov 14 16:01:13 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:13 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:13 user nova-compute[75097]:   <metadata>
Nov 14 16:01:13 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:13 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:13 user nova-compute[75097]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-531310718</nova:name>
Nov 14 16:01:13 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:13</nova:creationTime>
Nov 14 16:01:13 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:13 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:13 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:13 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:user uuid="66cdf7473a9947eaaf1ff2ade73bf6c7">tempest-AttachSCSIVolumeTestJSON-1241104298-project-member</nova:user>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:project uuid="a589b842262349c2b6acb10fd493a684">tempest-AttachSCSIVolumeTestJSON-1241104298</nova:project>
Nov 14 16:01:13 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:13 user nova-compute[75097]:       <nova:root type="image" uuid="98d746a1-6477-46ea-bdf4-cdb4091f4e31"/>
Nov 14 16:01:13 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:13 user nova-compute[75097]:         <nova:port uuid="fa27e284-4304-44eb-8148-4458b4fceca2">
Nov 14 16:01:13 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 16:01:13 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:13 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:13 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:13 user nova-compute[75097]:   </metadata>
Nov 14 16:01:13 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:13 user nova-compute[75097]:     <system>
Nov 14 16:01:13 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:13 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:13 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:13 user nova-compute[75097]:       <entry name="serial">e693c347-3d72-43eb-9a2f-77bee3d17210</entry>
Nov 14 16:01:13 user nova-compute[75097]:       <entry name="uuid">e693c347-3d72-43eb-9a2f-77bee3d17210</entry>
Nov 14 16:01:13 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:13 user nova-compute[75097]:     </system>
Nov 14 16:01:13 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:13 user nova-compute[75097]:   <os>
Nov 14 16:01:13 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:13 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:13 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:13 user nova-compute[75097]:   </os>
Nov 14 16:01:13 user nova-compute[75097]:   <features>
Nov 14 16:01:13 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:13 user nova-compute[75097]:     <apic/>
Nov 14 16:01:13 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:13 user nova-compute[75097]:   </features>
Nov 14 16:01:13 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:13 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:13 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:13 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:13 user nova-compute[75097]:   </clock>
Nov 14 16:01:13 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:13 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:13 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:13 user nova-compute[75097]:   </cpu>
Nov 14 16:01:13 user nova-compute[75097]:   <devices>
Nov 14 16:01:13 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:01:13 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:01:13 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk"/>
Nov 14 16:01:13 user nova-compute[75097]:       <target dev="sda" bus="scsi"/>
Nov 14 16:01:13 user nova-compute[75097]:       <address type="drive" controller="0" unit="0"/>
Nov 14 16:01:13 user nova-compute[75097]:     </disk>
Nov 14 16:01:13 user nova-compute[75097]:     <disk type="file" device="cdrom">
Nov 14 16:01:13 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 16:01:13 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.config"/>
Nov 14 16:01:13 user nova-compute[75097]:       <target dev="sdb" bus="scsi"/>
Nov 14 16:01:13 user nova-compute[75097]:       <address type="drive" controller="0" unit="1"/>
Nov 14 16:01:13 user nova-compute[75097]:     </disk>
Nov 14 16:01:13 user nova-compute[75097]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 16:01:13 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:13 user nova-compute[75097]:       <mac address="fa:16:3e:6a:cf:75"/>
Nov 14 16:01:13 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:13 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:13 user nova-compute[75097]:       <target dev="tapfa27e284-43"/>
Nov 14 16:01:13 user nova-compute[75097]:     </interface>
Nov 14 16:01:13 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:13 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/console.log" append="off"/>
Nov 14 16:01:13 user nova-compute[75097]:     </serial>
Nov 14 16:01:13 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:13 user nova-compute[75097]:     <video>
Nov 14 16:01:13 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:13 user nova-compute[75097]:     </video>
Nov 14 16:01:13 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:13 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:13 user nova-compute[75097]:     </rng>
Nov 14 16:01:13 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:13 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:13 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:13 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:13 user nova-compute[75097]:   </devices>
Nov 14 16:01:13 user nova-compute[75097]: </domain>
Nov 14 16:01:13 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-531310718',display_name='tempest-AttachSCSIVolumeTestJSON-server-531310718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-531310718',id=8,image_ref='98d746a1-6477-46ea-bdf4-cdb4091f4e31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2T7E8b7zQjsJ8sMDPaTog6XQ2CLarUONHdSA0TLB5qSAQ3VjwUrAhk0piT1ONX3jzYPAdd0xb4LQNBqpT0kCidvt2yYbhpJz/tSJ4TCMqI6XViLzmS5HPExH+5A47XBg==',key_name='tempest-keypair-1009317236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a589b842262349c2b6acb10fd493a684',ramdisk_id='',reservation_id='r-ngdosr0r',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98d746a1-6477-46ea-bdf4-cdb4091f4e31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1241104298',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1241104298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66cdf7473a9947eaaf1ff2ade73bf6c7',uuid=e693c347-3d72-43eb-9a2f-77bee3d17210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Converting VIF {"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG os_vif [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47888a16-1037-5472-ad16-d6c627e0e4fb', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa27e284-43, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa27e284-43, col_values=(('qos', UUID('08a4b942-322f-4e5c-a4cb-c002a30b0883')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa27e284-43, col_values=(('external_ids', {'iface-id': 'fa27e284-4304-44eb-8148-4458b4fceca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:cf:75', 'vm-uuid': 'e693c347-3d72-43eb-9a2f-77bee3d17210'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:13 user nova-compute[75097]: INFO os_vif [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43')
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No BDM found with device name sda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No VIF found with MAC fa:16:3e:6a:cf:75, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:13 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Using config drive
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-c8d39112-8e6c-4477-bd8d-5eb251ec3768 req-eb0f2ba5-0ea9-4973-b09e-d6c230973ae8 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c8d39112-8e6c-4477-bd8d-5eb251ec3768 req-eb0f2ba5-0ea9-4973-b09e-d6c230973ae8 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c8d39112-8e6c-4477-bd8d-5eb251ec3768 req-eb0f2ba5-0ea9-4973-b09e-d6c230973ae8 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c8d39112-8e6c-4477-bd8d-5eb251ec3768 req-eb0f2ba5-0ea9-4973-b09e-d6c230973ae8 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-c8d39112-8e6c-4477-bd8d-5eb251ec3768 req-eb0f2ba5-0ea9-4973-b09e-d6c230973ae8 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:13 user nova-compute[75097]: WARNING nova.compute.manager [req-c8d39112-8e6c-4477-bd8d-5eb251ec3768 req-eb0f2ba5-0ea9-4973-b09e-d6c230973ae8 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state None.
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updated VIF entry in instance network info cache for port fa27e284-4304-44eb-8148-4458b4fceca2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updating instance_info_cache with network_info: [{"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f089f815-ae34-43fd-8a3e-90ae8e9039a3 req-66fb94bc-5c63-44f1-94b2-4bc8162519eb service nova] Releasing lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Creating config drive at /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.config
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8hh6rfu9 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Successfully created port: 51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8hh6rfu9" returned: 0 in 0.095s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] No waiting events found dispatching network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:14 user nova-compute[75097]: WARNING nova.compute.manager [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received unexpected event network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 for instance with vm_state active and task_state None.
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:14 user nova-compute[75097]: WARNING nova.compute.manager [req-8688a2e9-d4b6-4e4e-b82c-82544730fbd6 req-37cb5601-2c59-4e0d-98fe-3d6c900e62db service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state None.
Nov 14 16:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Successfully updated port: 51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquired lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:15 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updating instance_info_cache with network_info: [{"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Releasing lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Instance network_info: |[{"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Start _get_guest_xml network_info=[{"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:16 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:16 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-194969293',display_name='tempest-TestVolumeSwap-server-194969293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-194969293',id=9,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfCzQm/vUYp9cV78CUQ35nLWokwJrPq1SVVXhGCTssrxXui4+Zlh6Vjih5/v5aCoav1Y3ZHj8FftY/KsIuOuhi/PcojTHLfsqPlR6ZZHheeJ69rsBrNvr3hPK5Kdb50gA==',key_name='tempest-keypair-718775986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d400c4a1bdd640b5991e15193e03b737',ramdisk_id='',reservation_id='r-kk0bwgqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1705499357',owner_user_name='tempest-TestVolumeSwap-1705499357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd3123fb41464b7c87ed6f4e98f4f15d',uuid=d1b28242-ed4b-4ba8-8d18-d92ab06c46af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Converting VIF {"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lazy-loading 'pci_devices' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:16 user nova-compute[75097]:   <uuid>d1b28242-ed4b-4ba8-8d18-d92ab06c46af</uuid>
Nov 14 16:01:16 user nova-compute[75097]:   <name>instance-00000009</name>
Nov 14 16:01:16 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:16 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:16 user nova-compute[75097]:   <metadata>
Nov 14 16:01:16 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:16 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:16 user nova-compute[75097]:       <nova:name>tempest-TestVolumeSwap-server-194969293</nova:name>
Nov 14 16:01:16 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:16</nova:creationTime>
Nov 14 16:01:16 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:16 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:16 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:16 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:user uuid="cd3123fb41464b7c87ed6f4e98f4f15d">tempest-TestVolumeSwap-1705499357-project-member</nova:user>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:project uuid="d400c4a1bdd640b5991e15193e03b737">tempest-TestVolumeSwap-1705499357</nova:project>
Nov 14 16:01:16 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:16 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:01:16 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:16 user nova-compute[75097]:         <nova:port uuid="51daeaf9-89d5-4bc7-8388-20e5bf938a55">
Nov 14 16:01:16 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:01:16 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:16 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:16 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:16 user nova-compute[75097]:   </metadata>
Nov 14 16:01:16 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:16 user nova-compute[75097]:     <system>
Nov 14 16:01:16 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:16 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:16 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:16 user nova-compute[75097]:       <entry name="serial">d1b28242-ed4b-4ba8-8d18-d92ab06c46af</entry>
Nov 14 16:01:16 user nova-compute[75097]:       <entry name="uuid">d1b28242-ed4b-4ba8-8d18-d92ab06c46af</entry>
Nov 14 16:01:16 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:16 user nova-compute[75097]:     </system>
Nov 14 16:01:16 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:16 user nova-compute[75097]:   <os>
Nov 14 16:01:16 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:16 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:16 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:16 user nova-compute[75097]:   </os>
Nov 14 16:01:16 user nova-compute[75097]:   <features>
Nov 14 16:01:16 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:16 user nova-compute[75097]:     <apic/>
Nov 14 16:01:16 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:16 user nova-compute[75097]:   </features>
Nov 14 16:01:16 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:16 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:16 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:16 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:16 user nova-compute[75097]:   </clock>
Nov 14 16:01:16 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:16 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:16 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:16 user nova-compute[75097]:   </cpu>
Nov 14 16:01:16 user nova-compute[75097]:   <devices>
Nov 14 16:01:16 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:01:16 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:01:16 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk"/>
Nov 14 16:01:16 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:01:16 user nova-compute[75097]:     </disk>
Nov 14 16:01:16 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:16 user nova-compute[75097]:       <mac address="fa:16:3e:1e:15:9a"/>
Nov 14 16:01:16 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:16 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:16 user nova-compute[75097]:       <target dev="tap51daeaf9-89"/>
Nov 14 16:01:16 user nova-compute[75097]:     </interface>
Nov 14 16:01:16 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:16 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/console.log" append="off"/>
Nov 14 16:01:16 user nova-compute[75097]:     </serial>
Nov 14 16:01:16 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:16 user nova-compute[75097]:     <video>
Nov 14 16:01:16 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:16 user nova-compute[75097]:     </video>
Nov 14 16:01:16 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:16 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:16 user nova-compute[75097]:     </rng>
Nov 14 16:01:16 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:16 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:16 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:16 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:16 user nova-compute[75097]:   </devices>
Nov 14 16:01:16 user nova-compute[75097]: </domain>
Nov 14 16:01:16 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-194969293',display_name='tempest-TestVolumeSwap-server-194969293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-194969293',id=9,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfCzQm/vUYp9cV78CUQ35nLWokwJrPq1SVVXhGCTssrxXui4+Zlh6Vjih5/v5aCoav1Y3ZHj8FftY/KsIuOuhi/PcojTHLfsqPlR6ZZHheeJ69rsBrNvr3hPK5Kdb50gA==',key_name='tempest-keypair-718775986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d400c4a1bdd640b5991e15193e03b737',ramdisk_id='',reservation_id='r-kk0bwgqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1705499357',owner_user_name='tempest-TestVolumeSwap-1705499357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd3123fb41464b7c87ed6f4e98f4f15d',uuid=d1b28242-ed4b-4ba8-8d18-d92ab06c46af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Converting VIF {"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG os_vif [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f383d413-0c9c-5a0e-8f61-81f2be25b475', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51daeaf9-89, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51daeaf9-89, col_values=(('qos', UUID('d8148364-0abf-4853-9440-b4762ff09acb')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51daeaf9-89, col_values=(('external_ids', {'iface-id': '51daeaf9-89d5-4bc7-8388-20e5bf938a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:15:9a', 'vm-uuid': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: INFO os_vif [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89')
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] No VIF found with MAC fa:16:3e:1e:15:9a, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:16 user nova-compute[75097]: WARNING nova.compute.manager [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state None.
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-changed-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Refreshing instance network info cache due to event network-changed-51daeaf9-89d5-4bc7-8388-20e5bf938a55. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] Acquiring lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] Acquired lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG nova.network.neutron [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Refreshing network info cache for port 51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "33225f43-00eb-4511-b81e-c92e5e617898" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:17 user nova-compute[75097]: INFO nova.compute.claims [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Claim successful on node user
Nov 14 16:01:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updated VIF entry in instance network info cache for port 51daeaf9-89d5-4bc7-8388-20e5bf938a55. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updating instance_info_cache with network_info: [{"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-16b5a58b-e496-42c0-82c1-a73f19d87367 req-c47daefe-0821-4a74-96ef-a7869243fa67 service nova] Releasing lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:17 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.policy [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecf3c1d42f7f426e8430eebf922f1ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33afa19cbde452dbd785d0936bd2601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Creating image(s)
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "/opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "/opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "/opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:01:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Instance spawned successfully.
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.229s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:18 user nova-compute[75097]: INFO nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Took 8.01 seconds to spawn the instance on the hypervisor.
Nov 14 16:01:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.299s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk 1073741824" returned: 0 in 0.082s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:18 user nova-compute[75097]: INFO nova.compute.manager [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Took 9.88 seconds to build instance.
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d3495644-3192-46c9-911e-c082aea60c2b tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.033s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Successfully created port: 81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.261s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Cannot resize image /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Ensure instance console log exists: /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-cf575340-d44b-4022-8b0e-abae69509189 req-7f89e959-5409-47a1-932f-80e9215e2098 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cf575340-d44b-4022-8b0e-abae69509189 req-7f89e959-5409-47a1-932f-80e9215e2098 service nova] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cf575340-d44b-4022-8b0e-abae69509189 req-7f89e959-5409-47a1-932f-80e9215e2098 service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cf575340-d44b-4022-8b0e-abae69509189 req-7f89e959-5409-47a1-932f-80e9215e2098 service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-cf575340-d44b-4022-8b0e-abae69509189 req-7f89e959-5409-47a1-932f-80e9215e2098 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] No waiting events found dispatching network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:19 user nova-compute[75097]: WARNING nova.compute.manager [req-cf575340-d44b-4022-8b0e-abae69509189 req-7f89e959-5409-47a1-932f-80e9215e2098 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received unexpected event network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c for instance with vm_state active and task_state None.
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Successfully updated port: 81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquired lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-changed-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Refreshing instance network info cache due to event network-changed-81879656-ed89-46e1-ba5b-55768c540167. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] Acquiring lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updating instance_info_cache with network_info: [{"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Releasing lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Instance network_info: |[{"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] Acquired lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.neutron [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Refreshing network info cache for port 81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Start _get_guest_xml network_info=[{"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:20 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-214608853',display_name='tempest-VolumesAssistedSnapshotsTest-server-214608853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-214608853',id=10,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3rFjTZJqLWjlRUcsYSJZaY6kTxs+emPkAHc7Qqi9qTg9TzRIw7cwSslPsPTtFY7oVCfLxr5wBp00nykiNCRSqm+kW8hCbiLRCZiqRm4LCViRaYl580iS0X2MJ0PIpnRg==',key_name='tempest-keypair-1411274199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f33afa19cbde452dbd785d0936bd2601',ramdisk_id='',reservation_id='r-jz0t9rdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-842364608',owner_user_name='tempest-VolumesAssistedSnapshotsTest-842364608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf3c1d42f7f426e8430eebf922f1ab3',uuid=33225f43-00eb-4511-b81e-c92e5e617898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Converting VIF {"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lazy-loading 'pci_devices' on Instance uuid 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:20 user nova-compute[75097]:   <uuid>33225f43-00eb-4511-b81e-c92e5e617898</uuid>
Nov 14 16:01:20 user nova-compute[75097]:   <name>instance-0000000a</name>
Nov 14 16:01:20 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:20 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:20 user nova-compute[75097]:   <metadata>
Nov 14 16:01:20 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:20 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:20 user nova-compute[75097]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-214608853</nova:name>
Nov 14 16:01:20 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:20</nova:creationTime>
Nov 14 16:01:20 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:20 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:20 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:20 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:user uuid="ecf3c1d42f7f426e8430eebf922f1ab3">tempest-VolumesAssistedSnapshotsTest-842364608-project-member</nova:user>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:project uuid="f33afa19cbde452dbd785d0936bd2601">tempest-VolumesAssistedSnapshotsTest-842364608</nova:project>
Nov 14 16:01:20 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:20 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:01:20 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:20 user nova-compute[75097]:         <nova:port uuid="81879656-ed89-46e1-ba5b-55768c540167">
Nov 14 16:01:20 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:01:20 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:20 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:20 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:20 user nova-compute[75097]:   </metadata>
Nov 14 16:01:20 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:20 user nova-compute[75097]:     <system>
Nov 14 16:01:20 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:20 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:20 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:20 user nova-compute[75097]:       <entry name="serial">33225f43-00eb-4511-b81e-c92e5e617898</entry>
Nov 14 16:01:20 user nova-compute[75097]:       <entry name="uuid">33225f43-00eb-4511-b81e-c92e5e617898</entry>
Nov 14 16:01:20 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:20 user nova-compute[75097]:     </system>
Nov 14 16:01:20 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:20 user nova-compute[75097]:   <os>
Nov 14 16:01:20 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:20 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:20 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:20 user nova-compute[75097]:   </os>
Nov 14 16:01:20 user nova-compute[75097]:   <features>
Nov 14 16:01:20 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:20 user nova-compute[75097]:     <apic/>
Nov 14 16:01:20 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:20 user nova-compute[75097]:   </features>
Nov 14 16:01:20 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:20 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:20 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:20 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:20 user nova-compute[75097]:   </clock>
Nov 14 16:01:20 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:20 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:20 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:20 user nova-compute[75097]:   </cpu>
Nov 14 16:01:20 user nova-compute[75097]:   <devices>
Nov 14 16:01:20 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:01:20 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:01:20 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk"/>
Nov 14 16:01:20 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:01:20 user nova-compute[75097]:     </disk>
Nov 14 16:01:20 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:20 user nova-compute[75097]:       <mac address="fa:16:3e:2e:b2:39"/>
Nov 14 16:01:20 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:20 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:20 user nova-compute[75097]:       <target dev="tap81879656-ed"/>
Nov 14 16:01:20 user nova-compute[75097]:     </interface>
Nov 14 16:01:20 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:20 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/console.log" append="off"/>
Nov 14 16:01:20 user nova-compute[75097]:     </serial>
Nov 14 16:01:20 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:20 user nova-compute[75097]:     <video>
Nov 14 16:01:20 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:20 user nova-compute[75097]:     </video>
Nov 14 16:01:20 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:20 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:20 user nova-compute[75097]:     </rng>
Nov 14 16:01:20 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:20 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:20 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:20 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:20 user nova-compute[75097]:   </devices>
Nov 14 16:01:20 user nova-compute[75097]: </domain>
Nov 14 16:01:20 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-214608853',display_name='tempest-VolumesAssistedSnapshotsTest-server-214608853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-214608853',id=10,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3rFjTZJqLWjlRUcsYSJZaY6kTxs+emPkAHc7Qqi9qTg9TzRIw7cwSslPsPTtFY7oVCfLxr5wBp00nykiNCRSqm+kW8hCbiLRCZiqRm4LCViRaYl580iS0X2MJ0PIpnRg==',key_name='tempest-keypair-1411274199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f33afa19cbde452dbd785d0936bd2601',ramdisk_id='',reservation_id='r-jz0t9rdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-842364608',owner_user_name='tempest-VolumesAssistedSnapshotsTest-842364608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf3c1d42f7f426e8430eebf922f1ab3',uuid=33225f43-00eb-4511-b81e-c92e5e617898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Converting VIF {"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG os_vif [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53b3f857-8b96-5aaa-81cf-6b5d2ca84e1a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81879656-ed, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81879656-ed, col_values=(('qos', UUID('0f2b8e7b-732e-4080-af14-5e4433e124fc')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81879656-ed, col_values=(('external_ids', {'iface-id': '81879656-ed89-46e1-ba5b-55768c540167', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:b2:39', 'vm-uuid': '33225f43-00eb-4511-b81e-c92e5e617898'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: INFO os_vif [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed')
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] No VIF found with MAC fa:16:3e:2e:b2:39, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.neutron [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updated VIF entry in instance network info cache for port 81879656-ed89-46e1-ba5b-55768c540167. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG nova.network.neutron [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updating instance_info_cache with network_info: [{"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-69085aed-9d43-4d9b-a58d-eeefd42ee5ec req-4f47b5c1-93cf-473c-8768-2be590780e2d service nova] Releasing lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:01:21 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Instance spawned successfully.
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:21 user nova-compute[75097]: INFO nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Took 9.16 seconds to spawn the instance on the hypervisor.
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:01:21 user nova-compute[75097]: INFO nova.compute.manager [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Took 11.56 seconds to build instance.
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ac1b5745-5048-4cc6-81b5-565df8445720 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.850s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] No waiting events found dispatching network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:21 user nova-compute[75097]: WARNING nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received unexpected event network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c for instance with vm_state active and task_state None.
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:21 user nova-compute[75097]: WARNING nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state active and task_state None.
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:21 user nova-compute[75097]: WARNING nova.compute.manager [req-4dd55fe2-31ac-4458-9955-954b3a3fc5c0 req-933f611b-3034-4e2a-bde0-997f5c37e4e4 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state active and task_state None.
Nov 14 16:01:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-75618a7c-a955-4e4e-8dec-3fad164514b0 req-5903cac7-d71a-465f-acfa-4278dd8994f2 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-75618a7c-a955-4e4e-8dec-3fad164514b0 req-5903cac7-d71a-465f-acfa-4278dd8994f2 service nova] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-75618a7c-a955-4e4e-8dec-3fad164514b0 req-5903cac7-d71a-465f-acfa-4278dd8994f2 service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-75618a7c-a955-4e4e-8dec-3fad164514b0 req-5903cac7-d71a-465f-acfa-4278dd8994f2 service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-75618a7c-a955-4e4e-8dec-3fad164514b0 req-5903cac7-d71a-465f-acfa-4278dd8994f2 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] No waiting events found dispatching network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:23 user nova-compute[75097]: WARNING nova.compute.manager [req-75618a7c-a955-4e4e-8dec-3fad164514b0 req-5903cac7-d71a-465f-acfa-4278dd8994f2 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received unexpected event network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 for instance with vm_state building and task_state spawning.
Nov 14 16:01:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:01:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Instance spawned successfully.
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:25 user nova-compute[75097]: INFO nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Took 7.36 seconds to spawn the instance on the hypervisor.
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:01:25 user nova-compute[75097]: INFO nova.compute.manager [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Took 8.63 seconds to build instance.
Nov 14 16:01:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad27f125-d8ab-4f7a-b87b-16af51b720f1 tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "33225f43-00eb-4511-b81e-c92e5e617898" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.801s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5f60965-d980-4fd8-83e5-55a35bd03d53 req-0219fa96-0748-4b6e-9b75-5f8946dac8b0 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5f60965-d980-4fd8-83e5-55a35bd03d53 req-0219fa96-0748-4b6e-9b75-5f8946dac8b0 service nova] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5f60965-d980-4fd8-83e5-55a35bd03d53 req-0219fa96-0748-4b6e-9b75-5f8946dac8b0 service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5f60965-d980-4fd8-83e5-55a35bd03d53 req-0219fa96-0748-4b6e-9b75-5f8946dac8b0 service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5f60965-d980-4fd8-83e5-55a35bd03d53 req-0219fa96-0748-4b6e-9b75-5f8946dac8b0 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] No waiting events found dispatching network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:25 user nova-compute[75097]: WARNING nova.compute.manager [req-e5f60965-d980-4fd8-83e5-55a35bd03d53 req-0219fa96-0748-4b6e-9b75-5f8946dac8b0 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received unexpected event network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 for instance with vm_state active and task_state None.
Nov 14 16:01:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:26 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:26 user nova-compute[75097]: INFO nova.compute.claims [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Claim successful on node user
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Creating image(s)
Nov 14 16:01:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "/opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "/opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:27 user nova-compute[75097]: DEBUG nova.policy [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fee585748b7840818bcf9040956472dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb3736fd3184f6aa1029ac74c11efb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.323s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.251s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk 1073741824" returned: 0 in 0.061s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Successfully created port: 0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.211s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Cannot resize image /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Ensure instance console log exists: /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-891a86ba-b30a-4648-ba88-7281760ded20 req-0d8d91da-1203-4bec-8e2e-77d470c7517a service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-891a86ba-b30a-4648-ba88-7281760ded20 req-0d8d91da-1203-4bec-8e2e-77d470c7517a service nova] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-891a86ba-b30a-4648-ba88-7281760ded20 req-0d8d91da-1203-4bec-8e2e-77d470c7517a service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-891a86ba-b30a-4648-ba88-7281760ded20 req-0d8d91da-1203-4bec-8e2e-77d470c7517a service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-891a86ba-b30a-4648-ba88-7281760ded20 req-0d8d91da-1203-4bec-8e2e-77d470c7517a service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] No waiting events found dispatching network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:29 user nova-compute[75097]: WARNING nova.compute.manager [req-891a86ba-b30a-4648-ba88-7281760ded20 req-0d8d91da-1203-4bec-8e2e-77d470c7517a service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received unexpected event network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 for instance with vm_state active and task_state None.
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Successfully updated port: 0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "refresh_cache-92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquired lock "refresh_cache-92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-changed-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Refreshing instance network info cache due to event network-changed-0af9e95a-3407-445f-bb60-e741e6815707. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] Acquiring lock "refresh_cache-92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Updating instance_info_cache with network_info: [{"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Releasing lock "refresh_cache-92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Instance network_info: |[{"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] Acquired lock "refresh_cache-92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.neutron [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Refreshing network info cache for port 0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Start _get_guest_xml network_info=[{"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1344476828',display_name='tempest-VolumesActionsTest-instance-1344476828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1344476828',id=11,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cb3736fd3184f6aa1029ac74c11efb0',ramdisk_id='',reservation_id='r-052qjlk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-171219910',owner_user_name='tempest-VolumesActionsTest-171219910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:28Z,user_data=None,user_id='fee585748b7840818bcf9040956472dc',uuid=92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Converting VIF {"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.objects.instance [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:29 user nova-compute[75097]:   <uuid>92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c</uuid>
Nov 14 16:01:29 user nova-compute[75097]:   <name>instance-0000000b</name>
Nov 14 16:01:29 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:29 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:29 user nova-compute[75097]:   <metadata>
Nov 14 16:01:29 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:29 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:29 user nova-compute[75097]:       <nova:name>tempest-VolumesActionsTest-instance-1344476828</nova:name>
Nov 14 16:01:29 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:29</nova:creationTime>
Nov 14 16:01:29 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:29 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:29 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:29 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:user uuid="fee585748b7840818bcf9040956472dc">tempest-VolumesActionsTest-171219910-project-member</nova:user>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:project uuid="3cb3736fd3184f6aa1029ac74c11efb0">tempest-VolumesActionsTest-171219910</nova:project>
Nov 14 16:01:29 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:29 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:01:29 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:29 user nova-compute[75097]:         <nova:port uuid="0af9e95a-3407-445f-bb60-e741e6815707">
Nov 14 16:01:29 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:01:29 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:29 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:29 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:29 user nova-compute[75097]:   </metadata>
Nov 14 16:01:29 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:29 user nova-compute[75097]:     <system>
Nov 14 16:01:29 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:29 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:29 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:29 user nova-compute[75097]:       <entry name="serial">92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c</entry>
Nov 14 16:01:29 user nova-compute[75097]:       <entry name="uuid">92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c</entry>
Nov 14 16:01:29 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:29 user nova-compute[75097]:     </system>
Nov 14 16:01:29 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:29 user nova-compute[75097]:   <os>
Nov 14 16:01:29 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:29 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:29 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:29 user nova-compute[75097]:   </os>
Nov 14 16:01:29 user nova-compute[75097]:   <features>
Nov 14 16:01:29 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:29 user nova-compute[75097]:     <apic/>
Nov 14 16:01:29 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:29 user nova-compute[75097]:   </features>
Nov 14 16:01:29 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:29 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:29 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:29 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:29 user nova-compute[75097]:   </clock>
Nov 14 16:01:29 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:29 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:29 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:29 user nova-compute[75097]:   </cpu>
Nov 14 16:01:29 user nova-compute[75097]:   <devices>
Nov 14 16:01:29 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:01:29 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:01:29 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk"/>
Nov 14 16:01:29 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:01:29 user nova-compute[75097]:     </disk>
Nov 14 16:01:29 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:29 user nova-compute[75097]:       <mac address="fa:16:3e:c0:52:8d"/>
Nov 14 16:01:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:29 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:29 user nova-compute[75097]:       <target dev="tap0af9e95a-34"/>
Nov 14 16:01:29 user nova-compute[75097]:     </interface>
Nov 14 16:01:29 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:29 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/console.log" append="off"/>
Nov 14 16:01:29 user nova-compute[75097]:     </serial>
Nov 14 16:01:29 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:29 user nova-compute[75097]:     <video>
Nov 14 16:01:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:29 user nova-compute[75097]:     </video>
Nov 14 16:01:29 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:29 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:29 user nova-compute[75097]:     </rng>
Nov 14 16:01:29 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:29 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:29 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:29 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:29 user nova-compute[75097]:   </devices>
Nov 14 16:01:29 user nova-compute[75097]: </domain>
Nov 14 16:01:29 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1344476828',display_name='tempest-VolumesActionsTest-instance-1344476828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1344476828',id=11,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cb3736fd3184f6aa1029ac74c11efb0',ramdisk_id='',reservation_id='r-052qjlk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-171219910',owner_user_name='tempest-VolumesActionsTest-171219910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:28Z,user_data=None,user_id='fee585748b7840818bcf9040956472dc',uuid=92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Converting VIF {"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG os_vif [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f4a3fc9-d009-555b-b5e8-4fd922c044d5', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0af9e95a-34, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0af9e95a-34, col_values=(('qos', UUID('536ce1d1-0b5e-4089-bb4e-a7ccf803ecb2')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0af9e95a-34, col_values=(('external_ids', {'iface-id': '0af9e95a-3407-445f-bb60-e741e6815707', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:52:8d', 'vm-uuid': '92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:29 user nova-compute[75097]: INFO os_vif [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34')
Nov 14 16:01:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] No VIF found with MAC fa:16:3e:c0:52:8d, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Updated VIF entry in instance network info cache for port 0af9e95a-3407-445f-bb60-e741e6815707. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Updating instance_info_cache with network_info: [{"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0810dfc5-a5da-4baa-9b58-6360b139164c req-c7c4b119-65b0-4dc5-b3e6-5b926bac5711 service nova] Releasing lock "refresh_cache-92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-40ee0a70-1fc6-4b18-b6a1-5fe92dcfa131 req-afb5140d-1320-40f1-86b6-69fa5e2b40cf service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40ee0a70-1fc6-4b18-b6a1-5fe92dcfa131 req-afb5140d-1320-40f1-86b6-69fa5e2b40cf service nova] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40ee0a70-1fc6-4b18-b6a1-5fe92dcfa131 req-afb5140d-1320-40f1-86b6-69fa5e2b40cf service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40ee0a70-1fc6-4b18-b6a1-5fe92dcfa131 req-afb5140d-1320-40f1-86b6-69fa5e2b40cf service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-40ee0a70-1fc6-4b18-b6a1-5fe92dcfa131 req-afb5140d-1320-40f1-86b6-69fa5e2b40cf service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] No waiting events found dispatching network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:31 user nova-compute[75097]: WARNING nova.compute.manager [req-40ee0a70-1fc6-4b18-b6a1-5fe92dcfa131 req-afb5140d-1320-40f1-86b6-69fa5e2b40cf service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received unexpected event network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 for instance with vm_state active and task_state None.
Nov 14 16:01:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:32 user nova-compute[75097]: INFO nova.compute.claims [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Claim successful on node user
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] No waiting events found dispatching network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:33 user nova-compute[75097]: WARNING nova.compute.manager [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received unexpected event network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 for instance with vm_state building and task_state spawning.
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] No waiting events found dispatching network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:33 user nova-compute[75097]: WARNING nova.compute.manager [req-fd138c01-1d56-43b5-8bd1-366df3982b59 req-c37addd0-6382-488f-8e7d-a7d1c4b61c86 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received unexpected event network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 for instance with vm_state building and task_state spawning.
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:33 user nova-compute[75097]: INFO nova.virt.block_device [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Booting with volume 7c8403c8-88a8-424e-a44c-c086e77bc633 at /dev/vda
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.policy [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dee794a8b12249a2b123faaaf05aa913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87eabd69961424da8fd9f3f265ca97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:01:33 user nova-compute[75097]: INFO oslo.privsep.daemon [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmln5d2iy/privsep.sock']
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:01:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Instance spawned successfully.
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:34 user sudo[86255]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmln5d2iy/privsep.sock
Nov 14 16:01:34 user sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:34 user nova-compute[75097]: INFO nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 14 16:01:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:01:34 user nova-compute[75097]: INFO nova.compute.manager [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Took 7.38 seconds to build instance.
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b717ac18-72e4-4a05-a31d-4e7955755243 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.524s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully created port: 544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully created port: eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully created port: 40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:35 user sudo[86255]: pam_unix(sudo:session): session closed for user root
Nov 14 16:01:35 user nova-compute[75097]: INFO oslo.privsep.daemon [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Spawned new privsep daemon via rootwrap
Nov 14 16:01:35 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 16:01:35 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 16:01:35 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 16:01:35 user nova-compute[75097]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86343
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5cdc7d-7b2a-4537-aeef-6d33a2f98d99]: (2,) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5796dc-a8fc-43a6-b432-18cc69aebc0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:36 user nova-compute[75097]: WARNING os_brick.initiator.connectors.nvmeof [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6357dce-54d8-4930-9df7-2fa1fa178033]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e13fae-de4d-4c11-a13e-f34e9879195c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f297b-99d5-4fce-87d2-4ec212fa1681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:01:36 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd71a5fb-4a79-4bd0-8790-9b52ebc0a114]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== get_connector_properties: return (2330ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating existing volume attachment record: 9ad8f583-90d8-493d-931e-9713e3c84b1b {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully created port: c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:36 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully created port: 48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: 544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-544ac7a9-ed32-4aad-8127-ca80d5c88853. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port 544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:37 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:37 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7118MB free_disk=25.457382202148438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.network.neutron [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.network.neutron [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fe2f72e7-5088-40bd-a07a-63e62cc3aaeb req-75142f4d-eb21-44aa-9f86-bbbc29833f93 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d65d5581-f4aa-49d6-9114-4b37cf70e513 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 34098dea-702d-454d-af5e-35b51cac9bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance e693c347-3d72-43eb-9a2f-77bee3d17210 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 33225f43-00eb-4511-b81e-c92e5e617898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 7581f138-f90b-4faa-aef0-e6bde1bf0ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:01:38 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: 6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.137s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-6e6c86c8-8570-44f1-998f-af9018b101f0. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.network.neutron [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port 6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG nova.network.neutron [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Skipping network cache update for instance because it is Building. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-b74dfc01-3793-4a14-9d8f-a32817ba1fb0. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid d65d5581-f4aa-49d6-9114-4b37cf70e513 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updating instance_info_cache with network_info: [{"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11ead728-fdef-4c12-a4a1-d4cc2e37cf20 req-70a90462-6537-43d6-8dd8-a81d3ebabbb6 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-d65d5581-f4aa-49d6-9114-4b37cf70e513" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: 40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:41 user nova-compute[75097]: INFO nova.virt.block_device [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Booting with volume e4952e0a-20ef-4169-b564-f87b796dbf45 at /dev/vdb
Nov 14 16:01:41 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec59f5e-be83-48ec-8abf-6f6d44a44d15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34babb1-3b7b-4c29-bd5c-d90df2494bec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc50cf1-9a01-49ff-99e9-4315115e3114]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f0c44a-c812-4702-9289-06cb5db2f15d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:01:41 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[898eab00-e7de-4eb0-bf67-d79912635545]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating existing volume attachment record: 3012d8a6-c23e-4a8f-b83e-0fadc199bc1d {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-eb02a90e-c3be-42ba-babb-d08381510228. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Successfully updated port: 48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-40804154-1531-468e-9b27-fc17182abda7. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port 40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-c68c49fb-3d40-4782-803e-81042732ab2a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcda2cfe-c0c8-46e6-981f-709a55cad56b req-7f109dbe-af6b-4c51-b5d3-971fea234821 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-48eb4287-364b-4ade-8da0-517ec73d875a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [{"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance network_info: |[{"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port 48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updated VIF entry in instance network info cache for port 48eb4287-364b-4ade-8da0-517ec73d875a. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [{"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-704e783a-9abf-4e39-b2df-a16b83006429 req-59dfcded-5be2-492e-b890-acdb6e2c84b1 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:46 user nova-compute[75097]: INFO nova.virt.block_device [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Booting with volume c0e3c124-3a7e-424b-b6e3-743f1c103989 at /dev/vdc
Nov 14 16:01:46 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad5c76d-5700-4ae7-bec7-750420afc6a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc01f2d9-0afa-4f6e-b7a3-2921cf889b1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc952779-b7a3-4be5-b400-22454397ee02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3636f8-9fc9-4889-a965-910183598c57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:01:46 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:01:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[516c27a9-af3f-4161-b9d0-1325626d5d7b]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:01:46 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating existing volume attachment record: bbf1c9ce-3819-49c7-9321-9fd2fdabc6ca {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:01:47 user nova-compute[75097]: INFO nova.compute.claims [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Claim successful on node user
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:01:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:01:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:48 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Creating image(s)
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "/opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "/opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "/opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.041s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG nova.policy [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70395fd6cc404605b59c004bc5c12fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13f5ead61764b4bab7304cd8c42d489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk 1073741824" returned: 0 in 0.051s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:01:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Cannot resize image /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Ensure instance console log exists: /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Successfully created port: e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Successfully updated port: e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "refresh_cache-94260c24-3457-4e7f-98a7-30cbbb4ae628" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquired lock "refresh_cache-94260c24-3457-4e7f-98a7-30cbbb4ae628" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-changed-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Refreshing instance network info cache due to event network-changed-e06855db-2643-41f1-9412-8d85f8611875. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] Acquiring lock "refresh_cache-94260c24-3457-4e7f-98a7-30cbbb4ae628" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:01:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Updating instance_info_cache with network_info: [{"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Releasing lock "refresh_cache-94260c24-3457-4e7f-98a7-30cbbb4ae628" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Instance network_info: |[{"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] Acquired lock "refresh_cache-94260c24-3457-4e7f-98a7-30cbbb4ae628" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Refreshing network info cache for port e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Start _get_guest_xml network_info=[{"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1384670079',display_name='tempest-VolumesNegativeTest-instance-1384670079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1384670079',id=13,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13f5ead61764b4bab7304cd8c42d489',ramdisk_id='',reservation_id='r-ib1n6aps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-458602789',owner_user_name='tempest-VolumesNegativeTest-458602789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:48Z,user_data=None,user_id='70395fd6cc404605b59c004bc5c12fed',uuid=94260c24-3457-4e7f-98a7-30cbbb4ae628,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Converting VIF {"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.objects.instance [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lazy-loading 'pci_devices' on Instance uuid 94260c24-3457-4e7f-98a7-30cbbb4ae628 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:50 user nova-compute[75097]:   <uuid>94260c24-3457-4e7f-98a7-30cbbb4ae628</uuid>
Nov 14 16:01:50 user nova-compute[75097]:   <name>instance-0000000d</name>
Nov 14 16:01:50 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:50 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:50 user nova-compute[75097]:   <metadata>
Nov 14 16:01:50 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:50 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:50 user nova-compute[75097]:       <nova:name>tempest-VolumesNegativeTest-instance-1384670079</nova:name>
Nov 14 16:01:50 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:50</nova:creationTime>
Nov 14 16:01:50 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:50 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:50 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:50 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:user uuid="70395fd6cc404605b59c004bc5c12fed">tempest-VolumesNegativeTest-458602789-project-member</nova:user>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:project uuid="b13f5ead61764b4bab7304cd8c42d489">tempest-VolumesNegativeTest-458602789</nova:project>
Nov 14 16:01:50 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:50 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:01:50 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:50 user nova-compute[75097]:         <nova:port uuid="e06855db-2643-41f1-9412-8d85f8611875">
Nov 14 16:01:50 user nova-compute[75097]:           <nova:ip type="fixed" address="192.168.233.67" ipVersion="4"/>
Nov 14 16:01:50 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:50 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:50 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:50 user nova-compute[75097]:   </metadata>
Nov 14 16:01:50 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:50 user nova-compute[75097]:     <system>
Nov 14 16:01:50 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:50 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:50 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:50 user nova-compute[75097]:       <entry name="serial">94260c24-3457-4e7f-98a7-30cbbb4ae628</entry>
Nov 14 16:01:50 user nova-compute[75097]:       <entry name="uuid">94260c24-3457-4e7f-98a7-30cbbb4ae628</entry>
Nov 14 16:01:50 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:50 user nova-compute[75097]:     </system>
Nov 14 16:01:50 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:50 user nova-compute[75097]:   <os>
Nov 14 16:01:50 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:50 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:50 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:50 user nova-compute[75097]:   </os>
Nov 14 16:01:50 user nova-compute[75097]:   <features>
Nov 14 16:01:50 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:50 user nova-compute[75097]:     <apic/>
Nov 14 16:01:50 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:50 user nova-compute[75097]:   </features>
Nov 14 16:01:50 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:50 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:50 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:50 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:50 user nova-compute[75097]:   </clock>
Nov 14 16:01:50 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:50 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:50 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:50 user nova-compute[75097]:   </cpu>
Nov 14 16:01:50 user nova-compute[75097]:   <devices>
Nov 14 16:01:50 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:01:50 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:01:50 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk"/>
Nov 14 16:01:50 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:01:50 user nova-compute[75097]:     </disk>
Nov 14 16:01:50 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:50 user nova-compute[75097]:       <mac address="fa:16:3e:dc:26:9b"/>
Nov 14 16:01:50 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:50 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:50 user nova-compute[75097]:       <target dev="tape06855db-26"/>
Nov 14 16:01:50 user nova-compute[75097]:     </interface>
Nov 14 16:01:50 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:50 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/console.log" append="off"/>
Nov 14 16:01:50 user nova-compute[75097]:     </serial>
Nov 14 16:01:50 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:50 user nova-compute[75097]:     <video>
Nov 14 16:01:50 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:50 user nova-compute[75097]:     </video>
Nov 14 16:01:50 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:50 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:50 user nova-compute[75097]:     </rng>
Nov 14 16:01:50 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:50 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:50 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:50 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:50 user nova-compute[75097]:   </devices>
Nov 14 16:01:50 user nova-compute[75097]: </domain>
Nov 14 16:01:50 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1384670079',display_name='tempest-VolumesNegativeTest-instance-1384670079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1384670079',id=13,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13f5ead61764b4bab7304cd8c42d489',ramdisk_id='',reservation_id='r-ib1n6aps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-458602789',owner_user_name='tempest-VolumesNegativeTest-458602789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:48Z,user_data=None,user_id='70395fd6cc404605b59c004bc5c12fed',uuid=94260c24-3457-4e7f-98a7-30cbbb4ae628,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Converting VIF {"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG os_vif [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65ea66fb-396c-511f-a0b7-a7c35da74838', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape06855db-26, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape06855db-26, col_values=(('qos', UUID('3506cd6b-8bf0-4ded-9531-9f33fcc2d6c4')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape06855db-26, col_values=(('external_ids', {'iface-id': 'e06855db-2643-41f1-9412-8d85f8611875', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:26:9b', 'vm-uuid': '94260c24-3457-4e7f-98a7-30cbbb4ae628'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:50 user nova-compute[75097]: INFO os_vif [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26')
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] No VIF found with MAC fa:16:3e:dc:26:9b, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Updated VIF entry in instance network info cache for port e06855db-2643-41f1-9412-8d85f8611875. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Updating instance_info_cache with network_info: [{"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5c06a460-79a3-45dd-95b6-0a6798429b5d req-73e86b12-68f8-459a-b84c-9d337d458bd7 service nova] Releasing lock "refresh_cache-94260c24-3457-4e7f-98a7-30cbbb4ae628" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:01:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Creating image(s)
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Ensure instance console log exists: /opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Start _get_guest_xml network_info=[{"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woehmfHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5', 'attached_at': '', 'detached_at': '', 'volume_id': '7c8403c8-88a8-424e-a44c-c086e77bc633', 'serial': '7c8403c8-88a8-424e-a44c-c086e77bc633'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '9ad8f583-90d8-493d-931e-9713e3c84b1b', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deMfqJXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4952e0a-20ef-4169-b564-f87b796dbf45', 'serial': 'e4952e0a-20ef-4169-b564-f87b796dbf45'}, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '3012d8a6-c23e-4a8f-b83e-0fadc199bc1d', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTIoWBZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0e3c124-3a7e-424b-b6e3-743f1c103989', 'serial': 'c0e3c124-3a7e-424b-b6e3-743f1c103989'}, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'bbf1c9ce-3819-49c7-9321-9fd2fdabc6ca', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:01:51 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:51 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connector [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Factory for ISCSI on None {{(pid=75097) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woehmfHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:01:51 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:01:51 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:01:51 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50818036-1bf5-4df6-9b89-8e063985c69a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:01:51 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[214120f2-0ebd-44ee-81a3-31a175eec75c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633] added
Nov 14 16:01:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[643bc6ac-635c-44b2-a959-fbbd2ab92450]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.098s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97995db-f971-4abf-9b79-5574ae8d469b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woehmfHr {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woehmfHr" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[587fc78a-8ad8-41ca-934d-8b304a5d7652]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woehmfHr'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e6827-8465-4be8-8f68-cc31a1387319]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4cafb-6517-491e-bda1-57cafc87f0b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:01:51 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:01:51 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:01:51 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:01:51 user nova-compute[75097]: 
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4025759-57fb-4c8f-a284-b1f90efc0c3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260]
Nov 14 16:01:51 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260] successful.
Nov 14 16:01:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c04caa-ad89-410c-b959-514fce7d62b0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ab6362-f715-422e-99dd-54c38b1c32be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[41848ff3-c4ef-4720-a5d8-02455f95beb4]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woehmfHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:01:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-030dd6de-9972-43fb-b857-2199b9bc2ea4 req-5db3ec18-4c59-46aa-9c84-9e31602b70e8 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-030dd6de-9972-43fb-b857-2199b9bc2ea4 req-5db3ec18-4c59-46aa-9c84-9e31602b70e8 service nova] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-030dd6de-9972-43fb-b857-2199b9bc2ea4 req-5db3ec18-4c59-46aa-9c84-9e31602b70e8 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-030dd6de-9972-43fb-b857-2199b9bc2ea4 req-5db3ec18-4c59-46aa-9c84-9e31602b70e8 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-030dd6de-9972-43fb-b857-2199b9bc2ea4 req-5db3ec18-4c59-46aa-9c84-9e31602b70e8 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] No waiting events found dispatching network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:52 user nova-compute[75097]: WARNING nova.compute.manager [req-030dd6de-9972-43fb-b857-2199b9bc2ea4 req-5db3ec18-4c59-46aa-9c84-9e31602b70e8 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received unexpected event network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 for instance with vm_state building and task_state spawning.
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23734393362613036', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734393362613036', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deMfqJXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:01:52 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:01:52 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:01:52 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b471089-1a6a-4962-b578-1ed4bbd54ed1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:01:52 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ed1047-838b-4dfd-99f2-071a1addd8fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45] added
Nov 14 16:01:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556cc00-5d2a-4237-9ba5-051668897534]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5945dc34-55d6-49b0-b04c-4ad22b41e294]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deMfqJXa {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v deMfqJXa" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cb1c5-6bdf-4bb5-afe8-1af7c04742cb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'deMfqJXa'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f0de5-eac2-477e-9083-e96576929c10]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f910de44-762b-444d-80c6-f941db1ed33c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1eaa47-31c8-4dca-8ef4-72a0108eb53e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260]
Nov 14 16:01:52 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260] successful.
Nov 14 16:01:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fda8dc9-6214-467e-8ba7-14f8cc605976]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ef8ce-9485-4d00-9553-cfd93487838f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:52 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:01:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:52 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:01:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf7913c-28af-4a92-b8bd-60465ad635ec]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:01:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deMfqJXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26162376431383061', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162376431383061', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTIoWBZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:01:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:01:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:01:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:01:53 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:01:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3c4b8f-f3b0-4ffc-8d7a-ca90cfaee3ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:01:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956301c-d65e-4e05-88d7-4e6326b98d6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989] added
Nov 14 16:01:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42641af-db0c-4506-8649-02ba8f2a885c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed1dd9-76ac-4e6e-a4c3-5357153868d7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTIoWBZe {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTIoWBZe" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0dd2e4-4117-4f8e-b5e4-23250fc7348d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTIoWBZe'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[491d48dd-6beb-422a-b987-6bd716e2c2da]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f952f468-691a-4312-9550-f5c74cfb1b72]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[af665a12-bf8b-46fe-93d2-5112057bc606]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260]
Nov 14 16:01:54 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260] successful.
Nov 14 16:01:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9c515c-356a-4519-86e7-b9ec3ee20cbc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81fc4ce-f4b5-4712-938b-36ab946075d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:01:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d34e893-c15b-4928-b85e-5c34119387af]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTIoWBZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-1d80a531-eb40-4aff-bbbf-10ff0a52ce54 req-1b2b749d-bdce-4d29-b361-6502d7cd1328 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1d80a531-eb40-4aff-bbbf-10ff0a52ce54 req-1b2b749d-bdce-4d29-b361-6502d7cd1328 service nova] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1d80a531-eb40-4aff-bbbf-10ff0a52ce54 req-1b2b749d-bdce-4d29-b361-6502d7cd1328 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1d80a531-eb40-4aff-bbbf-10ff0a52ce54 req-1b2b749d-bdce-4d29-b361-6502d7cd1328 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-1d80a531-eb40-4aff-bbbf-10ff0a52ce54 req-1b2b749d-bdce-4d29-b361-6502d7cd1328 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] No waiting events found dispatching network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:54 user nova-compute[75097]: WARNING nova.compute.manager [req-1d80a531-eb40-4aff-bbbf-10ff0a52ce54 req-1b2b749d-bdce-4d29-b361-6502d7cd1328 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received unexpected event network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 for instance with vm_state building and task_state spawning.
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:01:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Instance spawned successfully.
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:01:54 user nova-compute[75097]: INFO nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 14 16:01:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:01:54 user nova-compute[75097]: INFO nova.compute.manager [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Took 7.32 seconds to build instance.
Nov 14 16:01:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08536deb-fc1e-4c36-b37d-49f6ee5a4a08 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.432s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23130616664623032', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130616664623032', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lazy-loading 'pci_devices' on Instance uuid 7581f138-f90b-4faa-aef0-e6bde1bf0ae5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:01:55 user nova-compute[75097]:   <uuid>7581f138-f90b-4faa-aef0-e6bde1bf0ae5</uuid>
Nov 14 16:01:55 user nova-compute[75097]:   <name>instance-0000000c</name>
Nov 14 16:01:55 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:01:55 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:01:55 user nova-compute[75097]:   <metadata>
Nov 14 16:01:55 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:01:55 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:01:55 user nova-compute[75097]:       <nova:name>tempest-device-tagging-server-545316734</nova:name>
Nov 14 16:01:55 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:01:51</nova:creationTime>
Nov 14 16:01:55 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:01:55 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:01:55 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:01:55 user nova-compute[75097]:       <nova:owner>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:user uuid="dee794a8b12249a2b123faaaf05aa913">tempest-TaggedBootDevicesTest-157690292-project-member</nova:user>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:project uuid="f87eabd69961424da8fd9f3f265ca97b">tempest-TaggedBootDevicesTest-157690292</nova:project>
Nov 14 16:01:55 user nova-compute[75097]:       </nova:owner>
Nov 14 16:01:55 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:01:55 user nova-compute[75097]:       <nova:ports>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="544ac7a9-ed32-4aad-8127-ca80d5c88853">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="6e6c86c8-8570-44f1-998f-af9018b101f0">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="b74dfc01-3793-4a14-9d8f-a32817ba1fb0">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="eb02a90e-c3be-42ba-babb-d08381510228">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="40804154-1531-468e-9b27-fc17182abda7">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="c68c49fb-3d40-4782-803e-81042732ab2a">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:         <nova:port uuid="48eb4287-364b-4ade-8da0-517ec73d875a">
Nov 14 16:01:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 16:01:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:01:55 user nova-compute[75097]:       </nova:ports>
Nov 14 16:01:55 user nova-compute[75097]:     </nova:instance>
Nov 14 16:01:55 user nova-compute[75097]:   </metadata>
Nov 14 16:01:55 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:01:55 user nova-compute[75097]:     <system>
Nov 14 16:01:55 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:01:55 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:01:55 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:01:55 user nova-compute[75097]:       <entry name="serial">7581f138-f90b-4faa-aef0-e6bde1bf0ae5</entry>
Nov 14 16:01:55 user nova-compute[75097]:       <entry name="uuid">7581f138-f90b-4faa-aef0-e6bde1bf0ae5</entry>
Nov 14 16:01:55 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:01:55 user nova-compute[75097]:     </system>
Nov 14 16:01:55 user nova-compute[75097]:   </sysinfo>
Nov 14 16:01:55 user nova-compute[75097]:   <os>
Nov 14 16:01:55 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:01:55 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:01:55 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:01:55 user nova-compute[75097]:   </os>
Nov 14 16:01:55 user nova-compute[75097]:   <features>
Nov 14 16:01:55 user nova-compute[75097]:     <acpi/>
Nov 14 16:01:55 user nova-compute[75097]:     <apic/>
Nov 14 16:01:55 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:01:55 user nova-compute[75097]:   </features>
Nov 14 16:01:55 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:01:55 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:01:55 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:01:55 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:01:55 user nova-compute[75097]:   </clock>
Nov 14 16:01:55 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:01:55 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:01:55 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:01:55 user nova-compute[75097]:   </cpu>
Nov 14 16:01:55 user nova-compute[75097]:   <devices>
Nov 14 16:01:55 user nova-compute[75097]:     <disk type="file" device="cdrom">
Nov 14 16:01:55 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 16:01:55 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5/disk.config"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="hda" bus="ide"/>
Nov 14 16:01:55 user nova-compute[75097]:     </disk>
Nov 14 16:01:55 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:01:55 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:01:55 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <serial>7c8403c8-88a8-424e-a44c-c086e77bc633</serial>
Nov 14 16:01:55 user nova-compute[75097]:     </disk>
Nov 14 16:01:55 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:01:55 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:01:55 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <serial>e4952e0a-20ef-4169-b564-f87b796dbf45</serial>
Nov 14 16:01:55 user nova-compute[75097]:     </disk>
Nov 14 16:01:55 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:01:55 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:01:55 user nova-compute[75097]:       <source dev="/dev/sdd"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="vdc" bus="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <serial>c0e3c124-3a7e-424b-b6e3-743f1c103989</serial>
Nov 14 16:01:55 user nova-compute[75097]:     </disk>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:76:36:5a"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tap544ac7a9-ed"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:fd:d9:10"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tap6e6c86c8-85"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:a1:44:64"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tapb74dfc01-37"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:39:98:e9"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tapeb02a90e-c3"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:bd:d7:da"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tap40804154-15"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:3e:a6:a7"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tapc68c49fb-3d"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:01:55 user nova-compute[75097]:       <mac address="fa:16:3e:0f:17:3d"/>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:01:55 user nova-compute[75097]:       <target dev="tap48eb4287-36"/>
Nov 14 16:01:55 user nova-compute[75097]:     </interface>
Nov 14 16:01:55 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:01:55 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5/console.log" append="off"/>
Nov 14 16:01:55 user nova-compute[75097]:     </serial>
Nov 14 16:01:55 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:01:55 user nova-compute[75097]:     <video>
Nov 14 16:01:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:01:55 user nova-compute[75097]:     </video>
Nov 14 16:01:55 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:01:55 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:01:55 user nova-compute[75097]:     </rng>
Nov 14 16:01:55 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:01:55 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:01:55 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:01:55 user nova-compute[75097]:     </memballoon>
Nov 14 16:01:55 user nova-compute[75097]:   </devices>
Nov 14 16:01:55 user nova-compute[75097]: </domain>
Nov 14 16:01:55 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '197b11de-9964-5f08-9f58-ea0b60b829b5', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap544ac7a9-ed, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap544ac7a9-ed, col_values=(('qos', UUID('1f28413c-f760-4c30-bab3-5853b1861418')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap544ac7a9-ed, col_values=(('external_ids', {'iface-id': '544ac7a9-ed32-4aad-8127-ca80d5c88853', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:36:5a', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed')
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04549559-7147-5591-98ee-f6950f8851d4', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e6c86c8-85, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e6c86c8-85, col_values=(('qos', UUID('f2b9ba1a-c78d-40af-bb9d-b51910dd01ee')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e6c86c8-85, col_values=(('external_ids', {'iface-id': '6e6c86c8-8570-44f1-998f-af9018b101f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:d9:10', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85')
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d6592cf-3cf2-5565-8a9f-036e1b698b7e', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb74dfc01-37, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb74dfc01-37, col_values=(('qos', UUID('c4989ea4-875d-4f19-ad91-fd5232879f4c')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb74dfc01-37, col_values=(('external_ids', {'iface-id': 'b74dfc01-3793-4a14-9d8f-a32817ba1fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:44:64', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37')
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58796a67-a19c-51d6-ab43-0dff76362c9f', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb02a90e-c3, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb02a90e-c3, col_values=(('qos', UUID('4d05c546-94c2-4f88-be69-6b09d12f5f6f')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb02a90e-c3, col_values=(('external_ids', {'iface-id': 'eb02a90e-c3be-42ba-babb-d08381510228', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:98:e9', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3')
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dc388a4-0a80-5674-85cc-960707e4f464', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40804154-15, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40804154-15, col_values=(('qos', UUID('3a017ab3-9a38-4e83-995a-d9491a3b75e8')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40804154-15, col_values=(('external_ids', {'iface-id': '40804154-1531-468e-9b27-fc17182abda7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:d7:da', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15')
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a31b9c29-30ae-56d6-8bc7-f690e0bb517b', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc68c49fb-3d, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc68c49fb-3d, col_values=(('qos', UUID('4030d2f6-f3fa-4d2f-b6fd-c73708115717')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc68c49fb-3d, col_values=(('external_ids', {'iface-id': 'c68c49fb-3d40-4782-803e-81042732ab2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:a6:a7', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d')
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f19e0ed-a127-5942-b3c5-b7bda30a172e', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48eb4287-36, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48eb4287-36, col_values=(('qos', UUID('96681951-cbbd-4a3c-a175-a03c9eadf349')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48eb4287-36, col_values=(('external_ids', {'iface-id': '48eb4287-364b-4ade-8da0-517ec73d875a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:17:3d', 'vm-uuid': '7581f138-f90b-4faa-aef0-e6bde1bf0ae5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:55 user nova-compute[75097]: INFO os_vif [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36')
Nov 14 16:01:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] No BDM found with device name hda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:01:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] No VIF found with MAC fa:16:3e:76:36:5a, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] No VIF found with MAC fa:16:3e:bd:d7:da, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:01:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Using config drive
Nov 14 16:01:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Creating config drive at /opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5/disk.config
Nov 14 16:01:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn208xkm8 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:01:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn208xkm8" returned: 0 in 0.060s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:01:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-c37eefb8-9fc7-4a4d-b8b4-888d56a18c1a req-d40d3e06-300e-4c8b-9121-38ce61314d38 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c37eefb8-9fc7-4a4d-b8b4-888d56a18c1a req-d40d3e06-300e-4c8b-9121-38ce61314d38 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c37eefb8-9fc7-4a4d-b8b4-888d56a18c1a req-d40d3e06-300e-4c8b-9121-38ce61314d38 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c37eefb8-9fc7-4a4d-b8b4-888d56a18c1a req-d40d3e06-300e-4c8b-9121-38ce61314d38 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-c37eefb8-9fc7-4a4d-b8b4-888d56a18c1a req-d40d3e06-300e-4c8b-9121-38ce61314d38 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:58 user nova-compute[75097]: WARNING nova.compute.manager [req-c37eefb8-9fc7-4a4d-b8b4-888d56a18c1a req-d40d3e06-300e-4c8b-9121-38ce61314d38 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 for instance with vm_state building and task_state spawning.
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-36ab90b8-d77b-420a-9b7a-a0cc59b3b416 req-dcc89962-0031-4cb8-949e-552b3439ea46 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36ab90b8-d77b-420a-9b7a-a0cc59b3b416 req-dcc89962-0031-4cb8-949e-552b3439ea46 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36ab90b8-d77b-420a-9b7a-a0cc59b3b416 req-dcc89962-0031-4cb8-949e-552b3439ea46 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36ab90b8-d77b-420a-9b7a-a0cc59b3b416 req-dcc89962-0031-4cb8-949e-552b3439ea46 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-36ab90b8-d77b-420a-9b7a-a0cc59b3b416 req-dcc89962-0031-4cb8-949e-552b3439ea46 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:58 user nova-compute[75097]: WARNING nova.compute.manager [req-36ab90b8-d77b-420a-9b7a-a0cc59b3b416 req-dcc89962-0031-4cb8-949e-552b3439ea46 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 for instance with vm_state building and task_state spawning.
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-463bb064-7447-438f-9f3f-f973648c878c req-2af2e053-046e-481c-8a19-7e25cb0043ed service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-463bb064-7447-438f-9f3f-f973648c878c req-2af2e053-046e-481c-8a19-7e25cb0043ed service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-463bb064-7447-438f-9f3f-f973648c878c req-2af2e053-046e-481c-8a19-7e25cb0043ed service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-463bb064-7447-438f-9f3f-f973648c878c req-2af2e053-046e-481c-8a19-7e25cb0043ed service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-463bb064-7447-438f-9f3f-f973648c878c req-2af2e053-046e-481c-8a19-7e25cb0043ed service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:01:59 user nova-compute[75097]: WARNING nova.compute.manager [req-463bb064-7447-438f-9f3f-f973648c878c req-2af2e053-046e-481c-8a19-7e25cb0043ed service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 for instance with vm_state building and task_state spawning.
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:01:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-d6921474-97c1-426c-a733-1dacf65cdc10 req-2ae8d746-7dfc-4012-910e-75cfc693a77b service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:00 user nova-compute[75097]: WARNING nova.compute.manager [req-eb65917c-2633-4d98-a35d-d1d2f5b27fdf req-64a50b59-13c9-4880-a0e2-6d517cae7432 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a for instance with vm_state building and task_state spawning.
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:01 user nova-compute[75097]: WARNING nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 for instance with vm_state building and task_state spawning.
Nov 14 16:02:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:01 user nova-compute[75097]: WARNING nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a for instance with vm_state building and task_state spawning.
Nov 14 16:02:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:01 user nova-compute[75097]: WARNING nova.compute.manager [req-cac5579b-3d64-4332-9f93-cdfdc6868fc7 req-f514bcf4-0484-4105-9254-9c8f190a52a2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a for instance with vm_state building and task_state spawning.
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:02:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance spawned successfully.
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:02 user nova-compute[75097]: INFO nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Took 11.07 seconds to spawn the instance on the hypervisor.
Nov 14 16:02:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:02:02 user nova-compute[75097]: INFO nova.compute.manager [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Took 29.56 seconds to build instance.
Nov 14 16:02:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed81990c-194f-401c-97a1-04924ea8dc8b tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.661s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lazy-loading 'flavor' on Instance uuid d65d5581-f4aa-49d6-9114-4b37cf70e513 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:24 user nova-compute[75097]: INFO nova.compute.manager [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Attaching volume 44e4cb79-ae43-4215-8c98-23901a1a68eb to /dev/vdb
Nov 14 16:02:24 user nova-compute[75097]: DEBUG os_brick.utils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[571cadfe-2ca7-48a5-9c7e-dcd398a024aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92d30f5-05dd-4d1f-b52b-f619dec7a003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[90531b76-b6ca-4c78-a85f-e0903a5b3916]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30d90ed-0efa-4fa8-9cc9-a8c178040e86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:02:24 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:02:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a2d7f-5977-4f06-a627-57aaf7e52f10]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG os_brick.utils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:02:24 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updating existing volume attachment record: 39e5e7b6-9cc6-4075-b8a3-0377a86b723a {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:27 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:02:27 user nova-compute[75097]: INFO nova.compute.claims [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Claim successful on node user
Nov 14 16:02:27 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:02:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.policy [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0c8e2c01a9a4defa352c3e3fcbb4f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925bff9b1de4d35bc1a0c84437c4a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:02:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Creating image(s)
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "/opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "/opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "/opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.275s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Successfully created port: 075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk 1073741824" returned: 0 in 0.066s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: INFO nova.compute.manager [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Rescuing
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOoDfZjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:02:28 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:02:28 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:02:28 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b446260-dc75-43ed-95f4-af7e0486e4bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:02:28 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4259dc2-0e5b-44f8-8b9d-7b028fce2d5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb] added
Nov 14 16:02:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad89ab-9d64-49d8-929f-01d4379ba8e0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ac1e9-bcbd-4f11-82c6-45a64d2f257e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOoDfZjc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:02:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOoDfZjc" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4266ed7d-ed92-4774-8e71-48ac7ec79dba]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aOoDfZjc'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fadede-2fc0-4b39-925f-b35eb7c19c6b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b9e7f-dd10-4acd-a5e6-c0fe9bb96f61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Cannot resize image /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Ensure instance console log exists: /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89479d53-76e3-4520-bd2b-ecfeaeadb1c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260]
Nov 14 16:02:29 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260] successful.
Nov 14 16:02:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a7b26-4cb4-42c8-88f0-7ae02fe80e46]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c6cf99-0d4c-4871-98f9-a86f126b21d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb (non-flash)
Nov 14 16:02:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:29 user nova-compute[75097]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb (non-flash)
Nov 14 16:02:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6eb894-ed6a-4286-8390-45bb0b66756b]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOoDfZjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Successfully updated port: 075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "refresh_cache-dba4bc8c-6e06-4753-8d95-81d55520668d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquired lock "refresh_cache-dba4bc8c-6e06-4753-8d95-81d55520668d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-changed-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Refreshing instance network info cache due to event network-changed-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] Acquiring lock "refresh_cache-dba4bc8c-6e06-4753-8d95-81d55520668d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:02:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Updating instance_info_cache with network_info: [{"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Releasing lock "refresh_cache-dba4bc8c-6e06-4753-8d95-81d55520668d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Instance network_info: |[{"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] Acquired lock "refresh_cache-dba4bc8c-6e06-4753-8d95-81d55520668d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Refreshing network info cache for port 075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Start _get_guest_xml network_info=[{"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:02:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:02:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1925355705',display_name='tempest-ServersNegativeTestJSON-server-1925355705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1925355705',id=14,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d925bff9b1de4d35bc1a0c84437c4a88',ramdisk_id='',reservation_id='r-vq3d47xh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-912372315',owner_user_name='tempest-ServersNegativeTestJSON-912372315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:02:28Z,user_data=None,user_id='d0c8e2c01a9a4defa352c3e3fcbb4f8c',uuid=dba4bc8c-6e06-4753-8d95-81d55520668d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converting VIF {"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lazy-loading 'pci_devices' on Instance uuid dba4bc8c-6e06-4753-8d95-81d55520668d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:02:30 user nova-compute[75097]:   <uuid>dba4bc8c-6e06-4753-8d95-81d55520668d</uuid>
Nov 14 16:02:30 user nova-compute[75097]:   <name>instance-0000000e</name>
Nov 14 16:02:30 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:02:30 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:02:30 user nova-compute[75097]:   <metadata>
Nov 14 16:02:30 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:02:30 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:name>tempest-ServersNegativeTestJSON-server-1925355705</nova:name>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:02:30</nova:creationTime>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:02:30 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:02:30 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:owner>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:user uuid="d0c8e2c01a9a4defa352c3e3fcbb4f8c">tempest-ServersNegativeTestJSON-912372315-project-member</nova:user>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:project uuid="d925bff9b1de4d35bc1a0c84437c4a88">tempest-ServersNegativeTestJSON-912372315</nova:project>
Nov 14 16:02:30 user nova-compute[75097]:       </nova:owner>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:ports>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:port uuid="075fe1bc-bc02-41e6-9ec7-0cb65a2a2510">
Nov 14 16:02:30 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:02:30 user nova-compute[75097]:         </nova:port>
Nov 14 16:02:30 user nova-compute[75097]:       </nova:ports>
Nov 14 16:02:30 user nova-compute[75097]:     </nova:instance>
Nov 14 16:02:30 user nova-compute[75097]:   </metadata>
Nov 14 16:02:30 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:02:30 user nova-compute[75097]:     <system>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="serial">dba4bc8c-6e06-4753-8d95-81d55520668d</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="uuid">dba4bc8c-6e06-4753-8d95-81d55520668d</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:02:30 user nova-compute[75097]:     </system>
Nov 14 16:02:30 user nova-compute[75097]:   </sysinfo>
Nov 14 16:02:30 user nova-compute[75097]:   <os>
Nov 14 16:02:30 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:02:30 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:02:30 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:02:30 user nova-compute[75097]:   </os>
Nov 14 16:02:30 user nova-compute[75097]:   <features>
Nov 14 16:02:30 user nova-compute[75097]:     <acpi/>
Nov 14 16:02:30 user nova-compute[75097]:     <apic/>
Nov 14 16:02:30 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:02:30 user nova-compute[75097]:   </features>
Nov 14 16:02:30 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:02:30 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:02:30 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:02:30 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:02:30 user nova-compute[75097]:   </clock>
Nov 14 16:02:30 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:02:30 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:02:30 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:02:30 user nova-compute[75097]:   </cpu>
Nov 14 16:02:30 user nova-compute[75097]:   <devices>
Nov 14 16:02:30 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:02:30 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:02:30 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk"/>
Nov 14 16:02:30 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:     </disk>
Nov 14 16:02:30 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:02:30 user nova-compute[75097]:       <mac address="fa:16:3e:11:8c:d0"/>
Nov 14 16:02:30 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:02:30 user nova-compute[75097]:       <target dev="tap075fe1bc-bc"/>
Nov 14 16:02:30 user nova-compute[75097]:     </interface>
Nov 14 16:02:30 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:02:30 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/console.log" append="off"/>
Nov 14 16:02:30 user nova-compute[75097]:     </serial>
Nov 14 16:02:30 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:02:30 user nova-compute[75097]:     <video>
Nov 14 16:02:30 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:     </video>
Nov 14 16:02:30 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:02:30 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:02:30 user nova-compute[75097]:     </rng>
Nov 14 16:02:30 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:02:30 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:02:30 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:02:30 user nova-compute[75097]:     </memballoon>
Nov 14 16:02:30 user nova-compute[75097]:   </devices>
Nov 14 16:02:30 user nova-compute[75097]: </domain>
Nov 14 16:02:30 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1925355705',display_name='tempest-ServersNegativeTestJSON-server-1925355705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1925355705',id=14,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d925bff9b1de4d35bc1a0c84437c4a88',ramdisk_id='',reservation_id='r-vq3d47xh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-912372315',owner_user_name='tempest-ServersNegativeTestJSON-912372315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:02:28Z,user_data=None,user_id='d0c8e2c01a9a4defa352c3e3fcbb4f8c',uuid=dba4bc8c-6e06-4753-8d95-81d55520668d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converting VIF {"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG os_vif [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a6ac631-e1a2-59f2-9edc-9c5d5f842f41', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:02:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance destroyed successfully.
Nov 14 16:02:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Attempting rescue
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75097) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap075fe1bc-bc, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap075fe1bc-bc, col_values=(('qos', UUID('f8c7c0ae-6448-4d35-9b87-2a0d897508a5')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap075fe1bc-bc, col_values=(('external_ids', {'iface-id': '075fe1bc-bc02-41e6-9ec7-0cb65a2a2510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:8c:d0', 'vm-uuid': 'dba4bc8c-6e06-4753-8d95-81d55520668d'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:02:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Creating image(s)
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: INFO os_vif [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc')
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23137396134366563', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137396134366563', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lazy-loading 'flavor' on Instance uuid d65d5581-f4aa-49d6-9114-4b37cf70e513 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] No VIF found with MAC fa:16:3e:11:8c:d0, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:02:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:02:30 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:02:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:   <serial>44e4cb79-ae43-4215-8c98-23901a1a68eb</serial>
Nov 14 16:02:30 user nova-compute[75097]: </disk>
Nov 14 16:02:30 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue" returned: 0 in 0.045s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'migration_context' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.base [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<f6935556-dbaa-46f3-864b-73d26c5fcbf2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Start _get_guest_xml network_info=[{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:85:3f:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8453bef7-6457-4331-abaa-62588e201fe1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'resources' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.base [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<f6935556-dbaa-46f3-864b-73d26c5fcbf2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'numa_topology' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.base [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<f6935556-dbaa-46f3-864b-73d26c5fcbf2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:02:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:02:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Updated VIF entry in instance network info cache for port 075fe1bc-bc02-41e6-9ec7-0cb65a2a2510. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Updating instance_info_cache with network_info: [{"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.base [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<f6935556-dbaa-46f3-864b-73d26c5fcbf2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-276102445',display_name='tempest-ServerRescueNegativeTestJSON-server-276102445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-276102445',id=4,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-j0e00lv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:51Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=f6935556-dbaa-46f3-864b-73d26c5fcbf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:85:3f:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:85:3f:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'pci_devices' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-540c1ff4-5cb1-493d-9124-76f61e1eb39a req-c6665bb4-4a19-4451-ae91-38d78c7b28d0 service nova] Releasing lock "refresh_cache-dba4bc8c-6e06-4753-8d95-81d55520668d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.objects.base [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<f6935556-dbaa-46f3-864b-73d26c5fcbf2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:02:30 user nova-compute[75097]:   <uuid>f6935556-dbaa-46f3-864b-73d26c5fcbf2</uuid>
Nov 14 16:02:30 user nova-compute[75097]:   <name>instance-00000004</name>
Nov 14 16:02:30 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:02:30 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:02:30 user nova-compute[75097]:   <metadata>
Nov 14 16:02:30 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:02:30 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-276102445</nova:name>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:02:30</nova:creationTime>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:02:30 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:02:30 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:owner>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:user uuid="a0d1946be4a442eb9b3bc8343510f656">tempest-ServerRescueNegativeTestJSON-2084860496-project-member</nova:user>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:project uuid="826e20e537274874bd3e0236eca9629f">tempest-ServerRescueNegativeTestJSON-2084860496</nova:project>
Nov 14 16:02:30 user nova-compute[75097]:       </nova:owner>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:02:30 user nova-compute[75097]:       <nova:ports>
Nov 14 16:02:30 user nova-compute[75097]:         <nova:port uuid="9296ab82-d1f4-4a32-b252-c7cb9d091a30">
Nov 14 16:02:30 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 16:02:30 user nova-compute[75097]:         </nova:port>
Nov 14 16:02:30 user nova-compute[75097]:       </nova:ports>
Nov 14 16:02:30 user nova-compute[75097]:     </nova:instance>
Nov 14 16:02:30 user nova-compute[75097]:   </metadata>
Nov 14 16:02:30 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:02:30 user nova-compute[75097]:     <system>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="serial">f6935556-dbaa-46f3-864b-73d26c5fcbf2</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="uuid">f6935556-dbaa-46f3-864b-73d26c5fcbf2</entry>
Nov 14 16:02:30 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:02:30 user nova-compute[75097]:     </system>
Nov 14 16:02:30 user nova-compute[75097]:   </sysinfo>
Nov 14 16:02:30 user nova-compute[75097]:   <os>
Nov 14 16:02:30 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:02:30 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:02:30 user nova-compute[75097]:   </os>
Nov 14 16:02:30 user nova-compute[75097]:   <features>
Nov 14 16:02:30 user nova-compute[75097]:     <acpi/>
Nov 14 16:02:30 user nova-compute[75097]:     <apic/>
Nov 14 16:02:30 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:02:30 user nova-compute[75097]:   </features>
Nov 14 16:02:30 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:02:30 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:02:30 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:02:30 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:02:30 user nova-compute[75097]:   </clock>
Nov 14 16:02:30 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:02:30 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:02:30 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:02:30 user nova-compute[75097]:   </cpu>
Nov 14 16:02:30 user nova-compute[75097]:   <devices>
Nov 14 16:02:30 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:02:30 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:02:30 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue"/>
Nov 14 16:02:30 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:     </disk>
Nov 14 16:02:30 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:02:30 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:02:30 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk"/>
Nov 14 16:02:30 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:     </disk>
Nov 14 16:02:30 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:02:30 user nova-compute[75097]:       <mac address="fa:16:3e:85:3f:71"/>
Nov 14 16:02:30 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:02:30 user nova-compute[75097]:       <target dev="tap9296ab82-d1"/>
Nov 14 16:02:30 user nova-compute[75097]:     </interface>
Nov 14 16:02:30 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:02:30 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/console.log" append="off"/>
Nov 14 16:02:30 user nova-compute[75097]:     </serial>
Nov 14 16:02:30 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:02:30 user nova-compute[75097]:     <video>
Nov 14 16:02:30 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:02:30 user nova-compute[75097]:     </video>
Nov 14 16:02:30 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:02:30 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:02:30 user nova-compute[75097]:     </rng>
Nov 14 16:02:30 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:02:30 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:02:30 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:02:30 user nova-compute[75097]:     </memballoon>
Nov 14 16:02:30 user nova-compute[75097]:   </devices>
Nov 14 16:02:30 user nova-compute[75097]: </domain>
Nov 14 16:02:30 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance destroyed successfully.
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:02:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:85:3f:71, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] No VIF found with MAC fa:16:3e:17:d0:b2, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6612dfed-4802-4359-8d57-8144081f45ab tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.845s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-unplugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-unplugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:31 user nova-compute[75097]: WARNING nova.compute.manager [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-unplugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state active and task_state rescuing.
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:31 user nova-compute[75097]: WARNING nova.compute.manager [req-fc3246a2-b22e-4574-b038-de08d6836a1d req-39563bcb-93f9-42b2-aff6-70c7742abfe9 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state active and task_state rescuing.
Nov 14 16:02:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:32 user nova-compute[75097]: INFO nova.compute.manager [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Terminating instance
Nov 14 16:02:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-7c6dfa02-2af1-4fa2-85c8-e150925e9ee2 req-034098ba-af9f-4c9d-89f3-05eb0ebcad71 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-vif-unplugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7c6dfa02-2af1-4fa2-85c8-e150925e9ee2 req-034098ba-af9f-4c9d-89f3-05eb0ebcad71 service nova] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7c6dfa02-2af1-4fa2-85c8-e150925e9ee2 req-034098ba-af9f-4c9d-89f3-05eb0ebcad71 service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7c6dfa02-2af1-4fa2-85c8-e150925e9ee2 req-034098ba-af9f-4c9d-89f3-05eb0ebcad71 service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-7c6dfa02-2af1-4fa2-85c8-e150925e9ee2 req-034098ba-af9f-4c9d-89f3-05eb0ebcad71 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] No waiting events found dispatching network-vif-unplugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-7c6dfa02-2af1-4fa2-85c8-e150925e9ee2 req-034098ba-af9f-4c9d-89f3-05eb0ebcad71 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-vif-unplugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-d901c4a2-6210-4b1a-a79b-eff29cad5298 req-e5164fbb-50b3-48b3-9c11-68bd65fc91cd service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d901c4a2-6210-4b1a-a79b-eff29cad5298 req-e5164fbb-50b3-48b3-9c11-68bd65fc91cd service nova] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d901c4a2-6210-4b1a-a79b-eff29cad5298 req-e5164fbb-50b3-48b3-9c11-68bd65fc91cd service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d901c4a2-6210-4b1a-a79b-eff29cad5298 req-e5164fbb-50b3-48b3-9c11-68bd65fc91cd service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-d901c4a2-6210-4b1a-a79b-eff29cad5298 req-e5164fbb-50b3-48b3-9c11-68bd65fc91cd service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] No waiting events found dispatching network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:33 user nova-compute[75097]: WARNING nova.compute.manager [req-d901c4a2-6210-4b1a-a79b-eff29cad5298 req-e5164fbb-50b3-48b3-9c11-68bd65fc91cd service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received unexpected event network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 for instance with vm_state building and task_state spawning.
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Instance destroyed successfully.
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lazy-loading 'resources' on Instance uuid d65d5581-f4aa-49d6-9114-4b37cf70e513 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1135530486',display_name='tempest-DeleteServersTestJSON-server-1135530486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1135530486',id=1,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c7b1dfdadfa4f7d8ebdecc5ac2e5594',ramdisk_id='',reservation_id='r-nvea01vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-655881871',owner_user_name='tempest-DeleteServersTestJSON-655881871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:00:48Z,user_data=None,user_id='3832b7c7c20a49868173a61405397932',uuid=d65d5581-f4aa-49d6-9114-4b37cf70e513,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Converting VIF {"id": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "address": "fa:16:3e:17:d0:b2", "network": {"id": "223dac63-633d-46cf-a32e-35466d491870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1505114774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7b1dfdadfa4f7d8ebdecc5ac2e5594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6025f91f-da", "ovs_interfaceid": "6025f91f-dabd-4fb9-8d51-0b2a02e79206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_vif [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6025f91f-da, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=906f8b2e-8838-40a2-9012-64cef0dc9c89) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: INFO os_vif [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:d0:b2,bridge_name='br-int',has_traffic_filtering=True,id=6025f91f-dabd-4fb9-8d51-0b2a02e79206,network=Network(223dac63-633d-46cf-a32e-35466d491870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6025f91f-da')
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOoDfZjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:02:33 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd0d5b8-911a-487c-93de-1c16efb3ff52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:02:33 user nova-compute[75097]: No targets found.
Nov 14 16:02:33 user nova-compute[75097]: iSNS:
Nov 14 16:02:33 user nova-compute[75097]: No targets found.
Nov 14 16:02:33 user nova-compute[75097]: STATIC:
Nov 14 16:02:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb
Nov 14 16:02:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:02:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:02:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989
Nov 14 16:02:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:02:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:02:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633
Nov 14 16:02:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:02:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:02:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45
Nov 14 16:02:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:02:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:02:33 user nova-compute[75097]: FIRMWARE:
Nov 14 16:02:33 user nova-compute[75097]: No targets found.
Nov 14 16:02:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:02:33 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:02:33 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7f5a3-e095-4cfb-8aae-9dee85186a29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc620e0d-5cf0-46ff-945b-f7c5fb3d6739]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:33 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:33 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:33 user nova-compute[75097]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb (non-flash)
Nov 14 16:02:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:33 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:33 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:33 user nova-compute[75097]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb (non-flash)
Nov 14 16:02:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98763880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51135b15-affc-4c93-aae2-67688da456f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ea06b-fdc3-4669-bd09-ad42aa29627c]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa23259-19b8-4021-be99-fdf458491ee2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564fb48-cf10-455a-9e95-7cdeb454dca2]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db0069-81ca-4472-82f2-39077eb891ce]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7858cd3c-b664-4d39-b0a4-f98e77b2c3a9]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260]
Nov 14 16:02:33 user nova-compute[75097]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb, portal: 172.16.0.220,3260] successful.
Nov 14 16:02:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e4cb79-ae43-4215-8c98-23901a1a68eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[85878274-a468-4a1a-9057-f6cef57f05b5]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] <== disconnect_volume: return (294ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:02:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Deleting instance files /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513_del
Nov 14 16:02:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Deletion of /opt/stack/data/nova/instances/d65d5581-f4aa-49d6-9114-4b37cf70e513_del complete
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75097) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 16:02:33 user nova-compute[75097]: INFO nova.virt.libvirt.host [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] UEFI support detected
Nov 14 16:02:33 user nova-compute[75097]: INFO nova.compute.manager [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Took 1.79 seconds to destroy the instance on the hypervisor.
Nov 14 16:02:33 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:02:33 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c443f60-ce08-4808-9a94-29ad568872d0 req-43ee7fca-150b-4a34-af2a-e89e250fb9bf service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c443f60-ce08-4808-9a94-29ad568872d0 req-43ee7fca-150b-4a34-af2a-e89e250fb9bf service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c443f60-ce08-4808-9a94-29ad568872d0 req-43ee7fca-150b-4a34-af2a-e89e250fb9bf service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c443f60-ce08-4808-9a94-29ad568872d0 req-43ee7fca-150b-4a34-af2a-e89e250fb9bf service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c443f60-ce08-4808-9a94-29ad568872d0 req-43ee7fca-150b-4a34-af2a-e89e250fb9bf service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:34 user nova-compute[75097]: WARNING nova.compute.manager [req-6c443f60-ce08-4808-9a94-29ad568872d0 req-43ee7fca-150b-4a34-af2a-e89e250fb9bf service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state active and task_state rescuing.
Nov 14 16:02:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-3879ecd0-8f4e-4db3-934d-bd66bff3aeaf req-60d9482f-e813-4f12-9df7-291ceada231e service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3879ecd0-8f4e-4db3-934d-bd66bff3aeaf req-60d9482f-e813-4f12-9df7-291ceada231e service nova] Acquiring lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3879ecd0-8f4e-4db3-934d-bd66bff3aeaf req-60d9482f-e813-4f12-9df7-291ceada231e service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3879ecd0-8f4e-4db3-934d-bd66bff3aeaf req-60d9482f-e813-4f12-9df7-291ceada231e service nova] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-3879ecd0-8f4e-4db3-934d-bd66bff3aeaf req-60d9482f-e813-4f12-9df7-291ceada231e service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] No waiting events found dispatching network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:34 user nova-compute[75097]: WARNING nova.compute.manager [req-3879ecd0-8f4e-4db3-934d-bd66bff3aeaf req-60d9482f-e813-4f12-9df7-291ceada231e service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received unexpected event network-vif-plugged-6025f91f-dabd-4fb9-8d51-0b2a02e79206 for instance with vm_state active and task_state deleting.
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:35 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Took 1.13 seconds to deallocate network for instance.
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-fef594f4-53ec-4117-b54b-996055b55554 req-5199dea7-a420-4bd6-b521-519f8a5c75c7 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fef594f4-53ec-4117-b54b-996055b55554 req-5199dea7-a420-4bd6-b521-519f8a5c75c7 service nova] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fef594f4-53ec-4117-b54b-996055b55554 req-5199dea7-a420-4bd6-b521-519f8a5c75c7 service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fef594f4-53ec-4117-b54b-996055b55554 req-5199dea7-a420-4bd6-b521-519f8a5c75c7 service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-fef594f4-53ec-4117-b54b-996055b55554 req-5199dea7-a420-4bd6-b521-519f8a5c75c7 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] No waiting events found dispatching network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:35 user nova-compute[75097]: WARNING nova.compute.manager [req-fef594f4-53ec-4117-b54b-996055b55554 req-5199dea7-a420-4bd6-b521-519f8a5c75c7 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received unexpected event network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 for instance with vm_state building and task_state spawning.
Nov 14 16:02:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:35 user nova-compute[75097]: INFO nova.compute.manager [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:02:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Instance spawned successfully.
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:02:36 user nova-compute[75097]: INFO nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:36 user nova-compute[75097]: INFO nova.compute.manager [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Took 8.65 seconds to build instance.
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a4b0ebab-3469-4809-8a20-894a12e12814 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.785s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9db9c685-2e35-4101-9ff2-8e17ec9280c5 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-changed-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Refreshing instance network info cache due to event network-changed-665262a2-60e0-4453-aa2e-2e6373bc86cf. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.network.neutron [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Refreshing network info cache for port 665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:02:36 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Deleted allocations for instance d65d5581-f4aa-49d6-9114-4b37cf70e513
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] [instance: d65d5581-f4aa-49d6-9114-4b37cf70e513] Received event network-vif-deleted-6025f91f-dabd-4fb9-8d51-0b2a02e79206 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:02:36 user nova-compute[75097]: WARNING nova.compute.manager [req-5699fd12-7265-4d0a-bb7c-d507843cc070 req-046997ce-7c9c-4e6a-8cb4-2dee86069ee8 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state rescued and task_state None.
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-149aae39-3087-4a05-b8e1-3d5eb82f78b0 tempest-DeleteServersTestJSON-655881871 tempest-DeleteServersTestJSON-655881871-project-member] Lock "d65d5581-f4aa-49d6-9114-4b37cf70e513" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.628s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updated VIF entry in instance network info cache for port 665262a2-60e0-4453-aa2e-2e6373bc86cf. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-changed-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Refreshing instance network info cache due to event network-changed-ea4601d8-356b-454b-945c-c469766efbab. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Refreshing network info cache for port ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07b4141b-ad4a-42b6-a708-8037164df629 req-0fc1fa34-0d99-4900-8561-484b4b5b68a3 service nova] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updated VIF entry in instance network info cache for port ea4601d8-356b-454b-945c-c469766efbab. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c7cbb2e1-9e2c-4ae8-81b7-796bebe3d252 req-641fb99c-d973-417e-a247-bf393c1778ab service nova] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:02:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:02:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=6636MB free_disk=25.301502227783203GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance e693c347-3d72-43eb-9a2f-77bee3d17210 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94260c24-3457-4e7f-98a7-30cbbb4ae628 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 34098dea-702d-454d-af5e-35b51cac9bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance dba4bc8c-6e06-4753-8d95-81d55520668d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 33225f43-00eb-4511-b81e-c92e5e617898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 7581f138-f90b-4faa-aef0-e6bde1bf0ae5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:02:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:02:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:02:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:02:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:02:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updating instance_info_cache with network_info: [{"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:02:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-changed-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Refreshing instance network info cache due to event network-changed-6be39345-f45b-4a47-828b-d81f9766c60c. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] Acquiring lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] Acquired lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Refreshing network info cache for port 6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updated VIF entry in instance network info cache for port 6be39345-f45b-4a47-828b-d81f9766c60c. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updating instance_info_cache with network_info: [{"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ba75b0e1-ef11-4237-9167-90f30e5c5bd6 req-6ca63b15-78ee-4dab-8ee8-a32663cceabe service nova] Releasing lock "refresh_cache-34098dea-702d-454d-af5e-35b51cac9bbf" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG nova.objects.instance [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'flavor' on Instance uuid 34098dea-702d-454d-af5e-35b51cac9bbf {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:02:53 user nova-compute[75097]: INFO nova.compute.manager [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Attaching volume 3a118aec-2c4b-45ea-a0b2-054df3642597 to /dev/vdb
Nov 14 16:02:53 user nova-compute[75097]: DEBUG os_brick.utils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5315e64-3ce2-48b2-a6cf-554ef8503352]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf343b-9cc4-4256-9334-17d76f3310fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d83d93-c6d1-4dd9-9050-bec006fc5aff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[740781d4-6fda-49b5-be6e-3c1dbddf19ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:02:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:02:54 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:02:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[76017287-d852-485d-b43e-ccb635ba7fc0]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:02:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:02:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:02:54 user nova-compute[75097]: DEBUG os_brick.utils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:02:54 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updating existing volume attachment record: d094a8ff-1d6e-43cf-911b-b0d056787037 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:02:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfhgGIZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:02:58 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:02:58 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:02:58 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[054a852c-d8a5-4f80-b788-63d1bf7f8656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:02:58 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b9814-60d8-4c80-a634-bc89f72f3a1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597] added
Nov 14 16:02:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a84f47-3a86-4a30-9234-e05cc314e4c9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ce636-7517-441c-892b-faefbb6714a7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfhgGIZM {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfhgGIZM" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf95e50-54bb-4154-a996-693443f85c2b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rfhgGIZM'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c1b5b-1a6e-4b4a-8263-4d05d6b40b26]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[559d2f39-f3d5-49f6-bd3c-251cd372b07b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793aca5-2605-4e76-8b20-144c39e565a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260]
Nov 14 16:02:58 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260] successful.
Nov 14 16:02:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd23764c-3e48-4b3d-bc4d-81a29d752af2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8e7eba-5bb4-4288-9f13-3ae914ca2860]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:02:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c2642b-fbae-4357-a4d7-37bc4f670fdd]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:02:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfhgGIZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-changed-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Refreshing instance network info cache due to event network-changed-fa27e284-4304-44eb-8148-4458b4fceca2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] Acquiring lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] Acquired lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Refreshing network info cache for port fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23030316537383366', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030316537383366', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'flavor' on Instance uuid 34098dea-702d-454d-af5e-35b51cac9bbf {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:02:59 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:02:59 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:02:59 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:02:59 user nova-compute[75097]:   <serial>3a118aec-2c4b-45ea-a0b2-054df3642597</serial>
Nov 14 16:02:59 user nova-compute[75097]: </disk>
Nov 14 16:02:59 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updated VIF entry in instance network info cache for port fa27e284-4304-44eb-8148-4458b4fceca2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updating instance_info_cache with network_info: [{"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:02:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-49e93cca-df46-4a16-bc66-2354a4c68309 req-81f4e586-2ece-48a8-9468-6fd3e47d4389 service nova] Releasing lock "refresh_cache-e693c347-3d72-43eb-9a2f-77bee3d17210" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No VIF found with MAC fa:16:3e:89:53:94, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-95083c0d-8237-46d8-ac1a-50d2b9a96fc1 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.448s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lazy-loading 'flavor' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:00 user nova-compute[75097]: INFO nova.compute.manager [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Attaching volume b20e4661-b7cf-4373-a18a-4f2596f4175d to /dev/vdb
Nov 14 16:03:00 user nova-compute[75097]: DEBUG os_brick.utils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb89ce7-5683-42c1-9a34-4ee807312f90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a516dc9e-6eaa-490e-b094-d1abf31e0f29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1b1aa-86e4-4b5c-b62b-0bdf568a5eef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0639bb-02c9-4667-8c2c-04f4a504740a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:01 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8bdd4-81a6-40df-a561-00bdd62b5dbe]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG os_brick.utils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updating existing volume attachment record: 4f0a35ae-f45b-462d-a5b0-9eddc211f79d {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-changed-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Refreshing instance network info cache due to event network-changed-51daeaf9-89d5-4bc7-8388-20e5bf938a55. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] Acquiring lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] Acquired lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Refreshing network info cache for port 51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updated VIF entry in instance network info cache for port 51daeaf9-89d5-4bc7-8388-20e5bf938a55. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updating instance_info_cache with network_info: [{"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07a91270-b0fc-4b91-9fd0-bb892fd52022 req-18ce5c0f-4e9a-4e8b-8a97-3695773f59ee service nova] Releasing lock "refresh_cache-d1b28242-ed4b-4ba8-8d18-d92ab06c46af" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:01 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lazy-loading 'flavor' on Instance uuid e693c347-3d72-43eb-9a2f-77bee3d17210 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:02 user nova-compute[75097]: INFO nova.compute.manager [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Detaching volume 3a118aec-2c4b-45ea-a0b2-054df3642597
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:02 user nova-compute[75097]: INFO nova.compute.manager [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Attaching volume 5179a863-aaca-425c-aff5-4ba8b9da548e to /dev/sdc
Nov 14 16:03:02 user nova-compute[75097]: INFO nova.virt.block_device [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Attempting to driver detach volume 3a118aec-2c4b-45ea-a0b2-054df3642597 from mountpoint /dev/vdb
Nov 14 16:03:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Attempting to detach device vdb from instance 34098dea-702d-454d-af5e-35b51cac9bbf from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:02 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:02 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:03:02 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:02 user nova-compute[75097]:   <serial>3a118aec-2c4b-45ea-a0b2-054df3642597</serial>
Nov 14 16:03:02 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:03:02 user nova-compute[75097]: </disk>
Nov 14 16:03:02 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Successfully detached device vdb from instance 34098dea-702d-454d-af5e-35b51cac9bbf from the persistent domain config.
Nov 14 16:03:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34098dea-702d-454d-af5e-35b51cac9bbf from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:02 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:02 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:03:02 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:02 user nova-compute[75097]:   <serial>3a118aec-2c4b-45ea-a0b2-054df3642597</serial>
Nov 14 16:03:02 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:03:02 user nova-compute[75097]: </disk>
Nov 14 16:03:02 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG os_brick.utils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d47e12-5fd4-451f-a8c9-ac275532091c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605d1b1-daf8-4881-ba69-46da00948e23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec4811d-5669-46ef-8753-eabe1f0ae8c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5e74f5-d50d-4ac8-a9b2-8cc5cf8c88e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:02 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:03:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab27177-bc0a-4970-bb26-4f6d5f79cf2c]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG os_brick.utils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updating existing volume attachment record: 59ba145c-880c-4625-ab0a-e05fde6d3ab8 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:03:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34098dea-702d-454d-af5e-35b51cac9bbf {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:03:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:05 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:05 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:05 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2a307c-2d82-43a7-804f-30bb99b76e21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:03:05 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b791be-fe7f-42c7-858d-d81048eda049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d] added
Nov 14 16:03:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f589e90e-7668-4412-8f01-caf3a17e9e9d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45917a-e2c7-4e39-9bb0-a4e3f4e01e84]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUlkIdL {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUlkIdL" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be39a5c-0eda-4050-989d-04100a8c9d9c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKUlkIdL'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bacb9af-a3e4-4296-b12a-d1c80e98b6ca]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b6e355-e066-41b2-99ef-a6e430240edb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88bd84-5470-4ea9-84ab-026ed8cae56a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]
Nov 14 16:03:05 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b34a552-9872-4800-b758-279732b7b6fe]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f905c0b6-3692-4c7e-80f7-122475e61835]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:05 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b624a889-b1a9-4e19-83fb-325415272aac]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:03:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihjtEsDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:06 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26266643463363462', 'path': '/dev/sdf'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266643463363462', 'path': '/dev/sdf'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.071s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:06 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:06 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lazy-loading 'flavor' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3231f-316c-4c10-ae19-c0a05d957f70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:03:06 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:03:06 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:06 user nova-compute[75097]:   <source dev="/dev/sdf"/>
Nov 14 16:03:06 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:06 user nova-compute[75097]:   <serial>b20e4661-b7cf-4373-a18a-4f2596f4175d</serial>
Nov 14 16:03:06 user nova-compute[75097]: </disk>
Nov 14 16:03:06 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4536116a-0621-431a-a2c3-4e408244de4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e] added
Nov 14 16:03:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77e388-8cbe-40bb-8e9e-05c5668cc8d8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc145ad6-7505-4481-a122-cc2845710f5f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihjtEsDq {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihjtEsDq" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd6e929-0474-4e5d-b778-f2b75fdc5136]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ihjtEsDq'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[155cfaf6-de53-4380-ad55-f80a64b22eec]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3dc5fd-21af-4684-8718-87cf5b46d49f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:06 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d511d3fb-12bc-49ac-bb26-e12ee76ef908]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260]
Nov 14 16:03:06 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ea25ab-af69-4edf-9977-8f44b695f21e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020b864-ae90-447e-8738-4f7c98066563]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:07 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[78530458-4776-4798-a178-7d7c58eac389]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihjtEsDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] No VIF found with MAC fa:16:3e:1e:15:9a, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2afe4c50-f8a6-4693-bc02-3e7370a2dcb1 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.387s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-changed-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Refreshing instance network info cache due to event network-changed-81879656-ed89-46e1-ba5b-55768c540167. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] Acquiring lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] Acquired lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG nova.network.neutron [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Refreshing network info cache for port 81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.utils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f7400-fb65-4ad7-a672-9167f50a516d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab84d102-5065-43ca-b9ee-d25e43034f57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[59edeff6-d599-40a5-b485-755c90db1db6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb54fdc-683a-49c8-88e1-3e85b8b2b105]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:07 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:03:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee22b0e6-0aa0-49c3-be45-1bfffe94724e]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:03:07 user nova-compute[75097]: DEBUG os_brick.utils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "33225f43-00eb-4511-b81e-c92e5e617898" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lazy-loading 'flavor' on Instance uuid 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:08 user nova-compute[75097]: INFO nova.compute.manager [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Swapping volume b20e4661-b7cf-4373-a18a-4f2596f4175d for 423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23963613261376466', 'path': '/dev/sdg'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613261376466', 'path': '/dev/sdg'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lazy-loading 'flavor' on Instance uuid e693c347-3d72-43eb-9a2f-77bee3d17210 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "33225f43-00eb-4511-b81e-c92e5e617898" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:03:08 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:08 user nova-compute[75097]:   <source dev="/dev/sdg"/>
Nov 14 16:03:08 user nova-compute[75097]:   <target dev="sdc" bus="scsi"/>
Nov 14 16:03:08 user nova-compute[75097]:   <serial>5179a863-aaca-425c-aff5-4ba8b9da548e</serial>
Nov 14 16:03:08 user nova-compute[75097]:   <address type="drive" controller="0" unit="2"/>
Nov 14 16:03:08 user nova-compute[75097]: </disk>
Nov 14 16:03:08 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "33225f43-00eb-4511-b81e-c92e5e617898" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:08 user nova-compute[75097]: INFO nova.compute.manager [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Attaching volume 32491725-5694-4194-b0db-10d28b444c4a to /dev/vdb
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.utils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[245293be-518b-4cca-8066-b660d5992a6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[670293b5-d1fd-4474-acbc-319935b84e7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6b9c0-891a-4340-8990-57126e427ee0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9ad07-da66-42f6-b4e0-d0dd059b4f4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:08 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a82518-e367-437d-bc27-7c5bb69dc526]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG os_brick.utils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updating existing volume attachment record: fc466f7c-5e98-4fc3-a39e-d91200123e11 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No BDM found with device name sda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] No VIF found with MAC fa:16:3e:6a:cf:75, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updated VIF entry in instance network info cache for port 81879656-ed89-46e1-ba5b-55768c540167. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updating instance_info_cache with network_info: [{"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b57ecebd-50fe-43b6-bd74-a9144a2edb6c req-82003461-bbaa-42d4-8257-3a8a841406c3 service nova] Releasing lock "refresh_cache-33225f43-00eb-4511-b81e-c92e5e617898" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e6a231b-541d-4094-834e-4efe24b0adb4 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.502s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:10 user nova-compute[75097]: INFO nova.compute.manager [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Detaching volume 5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:10 user nova-compute[75097]: INFO nova.virt.block_device [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Attempting to driver detach volume 5179a863-aaca-425c-aff5-4ba8b9da548e from mountpoint /dev/sdc
Nov 14 16:03:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Attempting to detach device sdc from instance e693c347-3d72-43eb-9a2f-77bee3d17210 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:03:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:10 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:10 user nova-compute[75097]:   <source dev="/dev/sdg"/>
Nov 14 16:03:10 user nova-compute[75097]:   <target dev="sdc" bus="scsi"/>
Nov 14 16:03:10 user nova-compute[75097]:   <serial>5179a863-aaca-425c-aff5-4ba8b9da548e</serial>
Nov 14 16:03:10 user nova-compute[75097]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 16:03:10 user nova-compute[75097]: </disk>
Nov 14 16:03:10 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Successfully detached device sdc from instance e693c347-3d72-43eb-9a2f-77bee3d17210 from the persistent domain config.
Nov 14 16:03:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e693c347-3d72-43eb-9a2f-77bee3d17210 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:03:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:10 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:10 user nova-compute[75097]:   <source dev="/dev/sdg"/>
Nov 14 16:03:10 user nova-compute[75097]:   <target dev="sdc" bus="scsi"/>
Nov 14 16:03:10 user nova-compute[75097]:   <serial>5179a863-aaca-425c-aff5-4ba8b9da548e</serial>
Nov 14 16:03:10 user nova-compute[75097]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 16:03:10 user nova-compute[75097]: </disk>
Nov 14 16:03:10 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e693c347-3d72-43eb-9a2f-77bee3d17210 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:03:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErolULgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af', 'attached_at': '', 'detached_at': '', 'volume_id': '423ae872-5f4c-4370-8130-1dcb018df80c', 'serial': '423ae872-5f4c-4370-8130-1dcb018df80c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af', 'attached_at': '', 'detached_at': '', 'volume_id': 'b20e4661-b7cf-4373-a18a-4f2596f4175d', 'serial'} {{(pid=75097) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErolULgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:12 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:12 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:12 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ca11ca-1a1b-4853-a77d-b68c1216369e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:03:12 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d38adf-9c49-43ba-a4d4-fa5cd8496a58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c] added
Nov 14 16:03:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63bde84-40ef-4cad-aeeb-e9afcad41eed]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf470a8a-07f3-4d4f-ae27-17c6906a8cd4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErolULgk {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErolULgk" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72376ef-7007-498f-aa22-5f78a8e31bd6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErolULgk'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1c8ce-f80f-47fc-b81b-68e45b309d9a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee30426e-aaa2-4a03-9459-50d96e03d8a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3faa825-d53e-493f-80bd-3e5438c38a31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260]
Nov 14 16:03:12 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4bc872-136b-4f8e-b905-1552425d587f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e89e60-f939-46a6-b6d9-2b84a5c650bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:12 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a899b-4e75-4892-8b90-029ce549f56a]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:03:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErolULgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIOGdmZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:13 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26333376564663230', 'path': '/dev/sdh'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333376564663230', 'path': '/dev/sdh'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.535s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:13 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:13 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG nova.objects.instance [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lazy-loading 'flavor' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccabf50a-09cc-4421-b892-1e357c67ffdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:03:13 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279c810-7dd9-4abe-880c-9452e993eef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a] added
Nov 14 16:03:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220d54b-9b91-49b2-96a5-407de7b1065a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1348a45-e754-4c8f-8bb7-b19871a02614]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIOGdmZQ {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIOGdmZQ" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d1d158-1a38-46bd-b587-7ae04d90f236]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EIOGdmZQ'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f9829d-bd8a-4292-99e7-b3c446f0136e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c2a92-d47b-4043-b2bb-ac08d1d2e0a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0b02c0-1512-4df6-b0d5-0f1c71d3b1b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260]
Nov 14 16:03:14 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4fa473-753a-434f-b784-14449050bfe2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de5c02-2d54-47e2-a1a5-225586e628fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:14 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf4360-8214-4a04-8b9b-91c85a07bd26]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIOGdmZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] <== connect_volume: return (1889ms) {'type': 'block', 'scsi_wwn': '26461306633376239', 'path': '/dev/sdi'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461306633376239', 'path': '/dev/sdi'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lazy-loading 'flavor' on Instance uuid 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 16:03:15 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:15 user nova-compute[75097]:   <source dev="/dev/sdi"/>
Nov 14 16:03:15 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:15 user nova-compute[75097]:   <serial>32491725-5694-4194-b0db-10d28b444c4a</serial>
Nov 14 16:03:15 user nova-compute[75097]: </disk>
Nov 14 16:03:15 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 232783872 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 379584512 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] No VIF found with MAC fa:16:3e:2e:b2:39, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9054ae20-f800-4bb4-bcd9-6f759d330b6c tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "33225f43-00eb-4511-b81e-c92e5e617898" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.719s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 533725184 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 700448768 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] volume_snapshot_create: create_info: {'snapshot_id': '57732e2b-61da-4b41-9986-5c305cf13fee', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75097) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] snap xml: <domainsnapshot>
Nov 14 16:03:17 user nova-compute[75097]:   <disks>
Nov 14 16:03:17 user nova-compute[75097]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 14 16:03:17 user nova-compute[75097]:       <source file="/dev/new_file"/>
Nov 14 16:03:17 user nova-compute[75097]:     </disk>
Nov 14 16:03:17 user nova-compute[75097]:     <disk name="vda" snapshot="no"/>
Nov 14 16:03:17 user nova-compute[75097]:   </disks>
Nov 14 16:03:17 user nova-compute[75097]: </domainsnapshot>
Nov 14 16:03:17 user nova-compute[75097]:  {{(pid=75097) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.objects.instance [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] Lazy-loading 'system_metadata' on Instance uuid 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-419ebe00-6d0f-4367-a185-bdd2dd95fa35 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] volume_snapshot_delete: delete_info: {'volume_id': '32491725-5694-4194-b0db-10d28b444c4a'} {{(pid=75097) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [None req-419ebe00-6d0f-4367-a185-bdd2dd95fa35 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     if delete_info['type'] != 'qcow2':
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] KeyError: 'type'
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] 
Nov 14 16:03:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     rv = execute(f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     six.reraise(c, e, tb)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     raise value
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     rv = meth(*args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     self._volume_snapshot_create(context, instance, guest,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     rv = execute(f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     six.reraise(c, e, tb)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     raise value
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     rv = meth(*args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [instance: 33225f43-00eb-4511-b81e-c92e5e617898] 
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 849346560 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [None req-419ebe00-6d0f-4367-a185-bdd2dd95fa35 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9c3fc93c-c3bc-4e6d-b18d-84c684b2dbef)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server [None req-419ebe00-6d0f-4367-a185-bdd2dd95fa35 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] Exception during message handling: KeyError: 'type'
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 57732e2b-61da-4b41-9986-5c305cf13fee could not be found.
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 57732e2b-61da-4b41-9986-5c305cf13fee could not be found. (HTTP 404) (Request-ID: req-f793cfe8-7fc1-45af-aade-3f9c6e2834a2)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 57732e2b-61da-4b41-9986-5c305cf13fee could not be found.
Nov 14 16:03:17 user nova-compute[75097]: ERROR nova.virt.libvirt.driver 
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server [None req-afb184bb-6cd9-4419-958d-d314a6622922 tempest-VolumesAssistedSnapshotsTest-1075353386 tempest-VolumesAssistedSnapshotsTest-1075353386-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 16:03:17 user nova-compute[75097]: ERROR oslo_messaging.rpc.server 
Nov 14 16:03:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "33225f43-00eb-4511-b81e-c92e5e617898" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:17 user nova-compute[75097]: INFO nova.compute.manager [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Detaching volume 32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:17 user nova-compute[75097]: INFO nova.virt.block_device [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Attempting to driver detach volume 32491725-5694-4194-b0db-10d28b444c4a from mountpoint /dev/vdb
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Attempting to detach device vdb from instance 33225f43-00eb-4511-b81e-c92e5e617898 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:17 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:17 user nova-compute[75097]:   <source dev="/dev/sdi"/>
Nov 14 16:03:17 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:17 user nova-compute[75097]:   <serial>32491725-5694-4194-b0db-10d28b444c4a</serial>
Nov 14 16:03:17 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:03:17 user nova-compute[75097]: </disk>
Nov 14 16:03:17 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Successfully detached device vdb from instance 33225f43-00eb-4511-b81e-c92e5e617898 from the persistent domain config.
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33225f43-00eb-4511-b81e-c92e5e617898 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:17 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:17 user nova-compute[75097]:   <source dev="/dev/sdi"/>
Nov 14 16:03:17 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:17 user nova-compute[75097]:   <serial>32491725-5694-4194-b0db-10d28b444c4a</serial>
Nov 14 16:03:17 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:03:17 user nova-compute[75097]: </disk>
Nov 14 16:03:17 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 985661440 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:18 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f5ca6-13ee-479b-b573-ec580982cff2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:18 user nova-compute[75097]: No targets found.
Nov 14 16:03:18 user nova-compute[75097]: iSNS:
Nov 14 16:03:18 user nova-compute[75097]: No targets found.
Nov 14 16:03:18 user nova-compute[75097]: STATIC:
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:18 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:18 user nova-compute[75097]: No targets found.
Nov 14 16:03:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:18 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:18 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8038339-93f2-4b7f-8e8f-986662d991d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ab34c-ffa8-4bee-b371-16388dafe9d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:18 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf987cdb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d'): ({'sdf'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Removing single pathed devices sdf {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a260b27-441a-4ccb-9a60-25a3691e20fd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac71c01-0661-4966-a869-ab61ebd2b2e5]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Flushing IO for device /dev/sdf {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.039s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6afb3-dd9d-4813-8da6-cd708a0ec29d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.174s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ccd65-7fa8-41f3-b293-160ca616596e]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] SCSI volumes sdf have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8bd85-74bf-48de-bbf0-91236e18e7f2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfef374-85e4-447d-b580-84f45b53cecf]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]
Nov 14 16:03:18 user nova-compute[75097]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c7753-f92f-400a-a65f-b21005f85b81]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.506s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] <== disconnect_volume: return (506ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErolULgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af', 'attached_at': '', 'detached_at': '', 'volume_id': '423ae872-5f4c-4370-8130-1dcb018df80c', 'serial'} {{(pid=75097) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 16:03:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] swap_volume: removing Cinder connection for volume b20e4661-b7cf-4373-a18a-4f2596f4175d {{(pid=75097) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 16:03:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] swap_volume: Updating volume b20e4661-b7cf-4373-a18a-4f2596f4175d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ErolULgk", "auth_password": "VWuKMelLoHd1wE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "423ae872-5f4c-4370-8130-1dcb018df80c"}, "status": "reserved", "instance": "d1b28242-ed4b-4ba8-8d18-d92ab06c46af", "attached_at": "", "detached_at": "", "volume_id": "423ae872-5f4c-4370-8130-1dcb018df80c", "serial": "423ae872-5f4c-4370-8130-1dcb018df80c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '423ae872-5f4c-4370-8130-1dcb018df80c', 'no_device': None, 'attachment_id': '577fccd8-9a86-441d-8816-c39be8ce5439'} {{(pid=75097) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 16:03:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-98f1aa15-38dd-4744-b213-8fe951cd134c tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.108s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG os_brick.utils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a80ba2c-51c6-482a-b153-0755f8cbed2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd2c3bc-9652-42a6-8622-85a52480fa79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf40fd-a0cd-4155-bf86-1de62c88ab1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a432c79b-7c4e-4370-ab79-c0b39e7d6920]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:03:21 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5427b9f1-3933-4ca5-bf1d-4526fae86658]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG os_brick.utils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:21 user nova-compute[75097]: INFO nova.compute.manager [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Swapping volume 423ae872-5f4c-4370-8130-1dcb018df80c for b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:21 user nova-compute[75097]: INFO nova.compute.manager [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Terminating instance
Nov 14 16:03:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-15fe3f77-b6c0-40bc-9bf2-aa8b427ece54 req-00aaddd8-a2e3-4095-b520-3b0d09d23745 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-vif-unplugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-15fe3f77-b6c0-40bc-9bf2-aa8b427ece54 req-00aaddd8-a2e3-4095-b520-3b0d09d23745 service nova] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-15fe3f77-b6c0-40bc-9bf2-aa8b427ece54 req-00aaddd8-a2e3-4095-b520-3b0d09d23745 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-15fe3f77-b6c0-40bc-9bf2-aa8b427ece54 req-00aaddd8-a2e3-4095-b520-3b0d09d23745 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-15fe3f77-b6c0-40bc-9bf2-aa8b427ece54 req-00aaddd8-a2e3-4095-b520-3b0d09d23745 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] No waiting events found dispatching network-vif-unplugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-15fe3f77-b6c0-40bc-9bf2-aa8b427ece54 req-00aaddd8-a2e3-4095-b520-3b0d09d23745 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-vif-unplugged-0af9e95a-3407-445f-bb60-e741e6815707 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Instance destroyed successfully.
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lazy-loading 'resources' on Instance uuid 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1344476828',display_name='tempest-VolumesActionsTest-instance-1344476828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1344476828',id=11,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3cb3736fd3184f6aa1029ac74c11efb0',ramdisk_id='',reservation_id='r-052qjlk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-171219910',owner_user_name='tempest-VolumesActionsTest-171219910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:01:34Z,user_data=None,user_id='fee585748b7840818bcf9040956472dc',uuid=92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Converting VIF {"id": "0af9e95a-3407-445f-bb60-e741e6815707", "address": "fa:16:3e:c0:52:8d", "network": {"id": "60aec1f5-8110-407a-8a82-900815b5f45a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-454473666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cb3736fd3184f6aa1029ac74c11efb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0af9e95a-34", "ovs_interfaceid": "0af9e95a-3407-445f-bb60-e741e6815707", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_vif [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0af9e95a-34, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=536ce1d1-0b5e-4089-bb4e-a7ccf803ecb2) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:22 user nova-compute[75097]: INFO os_vif [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=0af9e95a-3407-445f-bb60-e741e6815707,network=Network(60aec1f5-8110-407a-8a82-900815b5f45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0af9e95a-34')
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Deleting instance files /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c_del
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Deletion of /opt/stack/data/nova/instances/92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c_del complete
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.compute.manager [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:03:22 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34098dea-702d-454d-af5e-35b51cac9bbf is timed out.
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Successfully detached device vdb from instance 34098dea-702d-454d-af5e-35b51cac9bbf from the live domain config.
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfhgGIZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:22 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6882dc0-35a6-42ef-a266-e19c1262cba4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:22 user nova-compute[75097]: No targets found.
Nov 14 16:03:22 user nova-compute[75097]: iSNS:
Nov 14 16:03:22 user nova-compute[75097]: No targets found.
Nov 14 16:03:22 user nova-compute[75097]: STATIC:
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:22 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:22 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:22 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:22 user nova-compute[75097]: No targets found.
Nov 14 16:03:22 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:22 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:22 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc9b7a-5dd5-4bee-bfae-24d174e8245b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c848c45-56be-42a2-868b-c63a2da2308f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:22 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:22 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:22 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Took 0.50 seconds to deallocate network for instance.
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-9614db48-48a8-4ecb-ac28-d2000fff0262 req-23b550ea-0075-4bf7-ba89-23a77b9a19d5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-vif-deleted-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:22 user nova-compute[75097]: INFO nova.compute.manager [req-9614db48-48a8-4ecb-ac28-d2000fff0262 req-23b550ea-0075-4bf7-ba89-23a77b9a19d5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Neutron deleted interface 0af9e95a-3407-445f-bb60-e741e6815707; detaching it from the instance and deleting it from the info cache
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.network.neutron [req-9614db48-48a8-4ecb-ac28-d2000fff0262 req-23b550ea-0075-4bf7-ba89-23a77b9a19d5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ba806-2165-4178-9622-99ea8994ba21]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-9614db48-48a8-4ecb-ac28-d2000fff0262 req-23b550ea-0075-4bf7-ba89-23a77b9a19d5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Detach interface failed, port_id=0af9e95a-3407-445f-bb60-e741e6815707, reason: Instance 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3159765e-dc0c-4e06-82f6-cf44322b809c]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb40d358-cc47-443e-854f-2f757c50bd40]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[367a80f3-2375-49c7-b2db-bcb1d49dae40]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[40574749-b746-4a5a-8c74-2296ffad6f05]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90aa95e-245b-488e-bb4b-fcd078db90ab]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260]
Nov 14 16:03:23 user nova-compute[75097]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a118aec-2c4b-45ea-a0b2-054df3642597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ccec3-1adb-4afc-af2c-9f3c7977eeef]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] <== disconnect_volume: return (439ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:23 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Deleted allocations for instance 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c
Nov 14 16:03:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-783f8089-0f96-4cb3-8927-58cc121331b9 tempest-VolumesActionsTest-171219910 tempest-VolumesActionsTest-171219910-project-member] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.909s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received event network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] Acquiring lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] Lock "92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] No waiting events found dispatching network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:24 user nova-compute[75097]: WARNING nova.compute.manager [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 92c2d1ac-f9a9-42c1-b6d5-e7de9dd3223c] Received unexpected event network-vif-plugged-0af9e95a-3407-445f-bb60-e741e6815707 for instance with vm_state deleted and task_state None.
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-changed-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing instance network info cache due to event network-changed-544ac7a9-ed32-4aad-8127-ca80d5c88853. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] Acquiring lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] Acquired lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.network.neutron [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Refreshing network info cache for port 544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.network.neutron [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updated VIF entry in instance network info cache for port 544ac7a9-ed32-4aad-8127-ca80d5c88853. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG nova.network.neutron [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [{"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b0a3d52-9017-4794-8f7d-d0d0a63c91b7 req-ff86cebb-a230-4925-b5a7-6e85ea020ea5 service nova] Releasing lock "refresh_cache-7581f138-f90b-4faa-aef0-e6bde1bf0ae5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:26 user nova-compute[75097]: INFO nova.compute.manager [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Terminating instance
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-659453cf-4162-46dd-81c0-e36880a6ebb1 req-35fb21a7-d211-47d5-95bf-8484b1d024b2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-659453cf-4162-46dd-81c0-e36880a6ebb1 req-35fb21a7-d211-47d5-95bf-8484b1d024b2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-659453cf-4162-46dd-81c0-e36880a6ebb1 req-35fb21a7-d211-47d5-95bf-8484b1d024b2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-659453cf-4162-46dd-81c0-e36880a6ebb1 req-35fb21a7-d211-47d5-95bf-8484b1d024b2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-659453cf-4162-46dd-81c0-e36880a6ebb1 req-35fb21a7-d211-47d5-95bf-8484b1d024b2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-659453cf-4162-46dd-81c0-e36880a6ebb1 req-35fb21a7-d211-47d5-95bf-8484b1d024b2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.objects.instance [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'flavor' on Instance uuid 34098dea-702d-454d-af5e-35b51cac9bbf {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-c1ce485b-d35f-4fc4-95b3-3e620d2fb048 req-8a52d531-3c67-45ca-a995-db4b81a79efd service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c1ce485b-d35f-4fc4-95b3-3e620d2fb048 req-8a52d531-3c67-45ca-a995-db4b81a79efd service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c1ce485b-d35f-4fc4-95b3-3e620d2fb048 req-8a52d531-3c67-45ca-a995-db4b81a79efd service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c1ce485b-d35f-4fc4-95b3-3e620d2fb048 req-8a52d531-3c67-45ca-a995-db4b81a79efd service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-c1ce485b-d35f-4fc4-95b3-3e620d2fb048 req-8a52d531-3c67-45ca-a995-db4b81a79efd service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-c1ce485b-d35f-4fc4-95b3-3e620d2fb048 req-8a52d531-3c67-45ca-a995-db4b81a79efd service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-6e6c86c8-8570-44f1-998f-af9018b101f0 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-566951d2-66b2-4e2e-a6de-d114e8869fbb tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.674s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af', 'attached_at': '', 'detached_at': '', 'volume_id': 'b20e4661-b7cf-4373-a18a-4f2596f4175d', 'serial': 'b20e4661-b7cf-4373-a18a-4f2596f4175d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErolULgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '423ae872-5f4c-4370-8130-1dcb018df80c'}, 'status': 'reserved', 'instance': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af', 'attached_at': '', 'detached_at': '', 'volume_id': '423ae872-5f4c-4370-8130-1dcb018df80c', 'serial'} {{(pid=75097) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:27 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0ae0d9-b9cc-4246-b139-3f08a3f67a15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:03:27 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[31adf2fb-e4fc-4a09-91fc-3c9f5af41bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d] added
Nov 14 16:03:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[362d6e9e-2456-4f00-9c32-535a096cfa6d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c718507-37f8-4e41-aec1-ea54f78a9324]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUlkIdL {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-5e9fa2b8-6f0c-403a-b782-211284af18f5 req-b07b548b-43ad-4ba9-b0cb-4b4ecb98142c service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5e9fa2b8-6f0c-403a-b782-211284af18f5 req-b07b548b-43ad-4ba9-b0cb-4b4ecb98142c service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5e9fa2b8-6f0c-403a-b782-211284af18f5 req-b07b548b-43ad-4ba9-b0cb-4b4ecb98142c service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5e9fa2b8-6f0c-403a-b782-211284af18f5 req-b07b548b-43ad-4ba9-b0cb-4b4ecb98142c service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-5e9fa2b8-6f0c-403a-b782-211284af18f5 req-b07b548b-43ad-4ba9-b0cb-4b4ecb98142c service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-5e9fa2b8-6f0c-403a-b782-211284af18f5 req-b07b548b-43ad-4ba9-b0cb-4b4ecb98142c service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-40804154-1531-468e-9b27-fc17182abda7 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKUlkIdL" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf8ad22-0582-41fb-95d8-aeed32c2e02a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKUlkIdL'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2db7ef-53f0-4229-9c13-5f95f0f51a3d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb522e-9db2-468c-87a4-fc83d48d907c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3909a804-078b-470d-85f1-f5c6b33803e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]
Nov 14 16:03:27 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3919b44a-95a7-4401-9d86-262d1847cc16]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9cea06-ad1c-4e64-8ae4-58697945f890]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:27 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c436f283-51e0-48fd-ab72-8adc78235b99]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Instance destroyed successfully.
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lazy-loading 'resources' on Instance uuid 7581f138-f90b-4faa-aef0-e6bde1bf0ae5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "address": "fa:16:3e:76:36:5a", "network": {"id": "307fb251-cd73-4fad-a04d-580350c523d6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1798720999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544ac7a9-ed", "ovs_interfaceid": "544ac7a9-ed32-4aad-8127-ca80d5c88853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap544ac7a9-ed, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f28413c-f760-4c30-bab3-5853b1861418) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:36:5a,bridge_name='br-int',has_traffic_filtering=True,id=544ac7a9-ed32-4aad-8127-ca80d5c88853,network=Network(307fb251-cd73-4fad-a04d-580350c523d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544ac7a9-ed')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e6c86c8-85, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2b9ba1a-c78d-40af-bb9d-b51910dd01ee) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d9:10,bridge_name='br-int',has_traffic_filtering=True,id=6e6c86c8-8570-44f1-998f-af9018b101f0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e6c86c8-85')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb74dfc01-37, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26266643463363462', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266643463363462', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lazy-loading 'flavor' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4989ea4-875d-4f19-ad91-fd5232879f4c) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:44:64,bridge_name='br-int',has_traffic_filtering=True,id=b74dfc01-3793-4a14-9d8f-a32817ba1fb0,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb74dfc01-37')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb02a90e-c3, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d05c546-94c2-4f88-be69-6b09d12f5f6f) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:98:e9,bridge_name='br-int',has_traffic_filtering=True,id=eb02a90e-c3be-42ba-babb-d08381510228,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02a90e-c3')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40804154-15, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a017ab3-9a38-4e83-995a-d9491a3b75e8) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d7:da,bridge_name='br-int',has_traffic_filtering=True,id=40804154-1531-468e-9b27-fc17182abda7,network=Network(e30827a8-754f-45a6-81ec-d360655dcff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40804154-15')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc68c49fb-3d, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4030d2f6-f3fa-4d2f-b6fd-c73708115717) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a6:a7,bridge_name='br-int',has_traffic_filtering=True,id=c68c49fb-3d40-4782-803e-81042732ab2a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68c49fb-3d')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-545316734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-545316734',id=12,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoQfQogi3tFQau5x6IAcnx/c5Hljl1rOWLGOl4uXClyJHdueBmuZNaUpMoCJM0Fm3gRlwPDaHsE/MKJUbIv5yQnhhS065PBItjTChKlgcI5XGpwH/ZbiWrfmgjdSRQprQ==',key_name='tempest-keypair-254583606',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87eabd69961424da8fd9f3f265ca97b',ramdisk_id='',reservation_id='r-lz9ebedl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-157690292',owner_user_name='tempest-TaggedBootDevicesTest-157690292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee794a8b12249a2b123faaaf05aa913',uuid=7581f138-f90b-4faa-aef0-e6bde1bf0ae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converting VIF {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48eb4287-36, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96681951-cbbd-4a3c-a175-a03c9eadf349) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-544ac7a9-ed32-4aad-8127-ca80d5c88853 for instance with vm_state active and task_state deleting.
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-b74dfc01-3793-4a14-9d8f-a32817ba1fb0 for instance with vm_state active and task_state deleting.
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-eb02a90e-c3be-42ba-babb-d08381510228 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING nova.compute.manager [req-88115553-aec9-4a33-b07d-99f526e043e8 req-4a78c89a-d76c-498c-8909-94ad327f61e2 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-eb02a90e-c3be-42ba-babb-d08381510228 for instance with vm_state active and task_state deleting.
Nov 14 16:03:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:28 user nova-compute[75097]: INFO os_vif [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:17:3d,bridge_name='br-int',has_traffic_filtering=True,id=48eb4287-364b-4ade-8da0-517ec73d875a,network=Network(f9631ab6-6886-4b8e-8797-3059b7c5ba74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48eb4287-36')
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woehmfHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45ae5d-80d1-4564-b8f5-539809b6e275]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:28 user nova-compute[75097]: No targets found.
Nov 14 16:03:28 user nova-compute[75097]: iSNS:
Nov 14 16:03:28 user nova-compute[75097]: No targets found.
Nov 14 16:03:28 user nova-compute[75097]: STATIC:
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:28 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:28 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:28 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:28 user nova-compute[75097]: No targets found.
Nov 14 16:03:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:28 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:28 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[47babb7b-4461-412e-a4f2-c6080cc79727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0af491-314a-42f2-ae04-7759308aa931]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:28 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aaa1e1-af5a-483c-a40e-223d4d56b718]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8aafc-369e-47fb-a6ed-669f806ded61]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[463055f7-2431-4419-aadd-1caf358cb191]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1292011-dc29-4b76-9bcf-555f10278e8f]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 2097152 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c8bd7-6a89-42dc-b3ce-60f001cec84d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-6e6c86c8-8570-44f1-998f-af9018b101f0 for instance with vm_state active and task_state deleting.
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-c68c49fb-3d40-4782-803e-81042732ab2a for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING nova.compute.manager [req-79664b98-fe11-4a12-932b-437166cb9aab req-421f85cf-f148-47d2-8394-32baaeb214db service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-c68c49fb-3d40-4782-803e-81042732ab2a for instance with vm_state active and task_state deleting.
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23705cc8-440b-4b7a-8d59-338cf3a9b7a4]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260]
Nov 14 16:03:28 user nova-compute[75097]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c8403c8-88a8-424e-a44c-c086e77bc633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[879ebc76-be72-4f93-a5f0-b3d0085a2023]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== disconnect_volume: return (324ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'deMfqJXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:28 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5953a8-1df4-49ec-9271-b14ee1225d62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:29 user nova-compute[75097]: No targets found.
Nov 14 16:03:29 user nova-compute[75097]: iSNS:
Nov 14 16:03:29 user nova-compute[75097]: No targets found.
Nov 14 16:03:29 user nova-compute[75097]: STATIC:
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:29 user nova-compute[75097]: No targets found.
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:29 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:29 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2642d676-1f55-4a5d-a2c8-8df08c32b482]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c1bb4-5e13-4ffd-aaee-7eade844f418]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d85da-97fb-4492-aab6-4f87c69ac156]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d301d4-e852-4535-9909-0f4c33771361]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1e2c8-dfe5-4872-b2a5-33f4d3bf1e86]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89c2631-b705-4ced-bd08-65f72738c63b]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:29 user nova-compute[75097]: WARNING nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-40804154-1531-468e-9b27-fc17182abda7 for instance with vm_state active and task_state deleting.
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-unplugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-unplugged-48eb4287-364b-4ade-8da0-517ec73d875a for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Acquiring lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] No waiting events found dispatching network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:29 user nova-compute[75097]: WARNING nova.compute.manager [req-e5144762-563a-40fd-9073-6950eb5d181d req-92afecc8-5f5a-4877-8c20-167fa3547037 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received unexpected event network-vif-plugged-48eb4287-364b-4ade-8da0-517ec73d875a for instance with vm_state active and task_state deleting.
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[997fe59e-c19b-4e72-95e2-ba78fcec7099]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d420f-11de-49d0-8fed-df0367136201]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260]
Nov 14 16:03:29 user nova-compute[75097]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4952e0a-20ef-4169-b564-f87b796dbf45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[30163c02-c206-4384-9da2-33cdde247990]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== disconnect_volume: return (377ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTIoWBZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa554622-d73d-494a-be05-922677529152]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:29 user nova-compute[75097]: No targets found.
Nov 14 16:03:29 user nova-compute[75097]: iSNS:
Nov 14 16:03:29 user nova-compute[75097]: No targets found.
Nov 14 16:03:29 user nova-compute[75097]: STATIC:
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:29 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:29 user nova-compute[75097]: No targets found.
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:29 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:29 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd3eb44-8fb4-4b4b-b412-10e861ee8403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc649d-5858-427b-9caa-6ba788ec9a53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:29 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981bedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a068499d-49fd-47b8-80ab-643b74b5c4bc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[035921ff-bb74-4795-80fa-d13120e88273]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814f4bc-5a09-460c-9bbe-00b290b8a52d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c58db04-90ef-4df8-9a14-6f580c075016]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07234c-7816-4f04-879c-9fb7ec8c6d78]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ccd55-a9b3-48d8-b89d-1315b571f59e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260]
Nov 14 16:03:29 user nova-compute[75097]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e3c124-3a7e-424b-b6e3-743f1c103989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60be08c-8fe2-4f11-b0f3-bad388382e04]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] <== disconnect_volume: return (343ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Deleting instance files /opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5_del
Nov 14 16:03:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Deletion of /opt/stack/data/nova/instances/7581f138-f90b-4faa-aef0-e6bde1bf0ae5_del complete
Nov 14 16:03:29 user nova-compute[75097]: INFO nova.compute.manager [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Took 3.66 seconds to destroy the instance on the hypervisor.
Nov 14 16:03:29 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:03:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 281018368 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 426770432 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e693c347-3d72-43eb-9a2f-77bee3d17210 is timed out.
Nov 14 16:03:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Successfully detached device sdc from instance e693c347-3d72-43eb-9a2f-77bee3d17210 from the live domain config.
Nov 14 16:03:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihjtEsDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f735010-0dee-402f-b81b-478db48106bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:30 user nova-compute[75097]: No targets found.
Nov 14 16:03:30 user nova-compute[75097]: iSNS:
Nov 14 16:03:30 user nova-compute[75097]: No targets found.
Nov 14 16:03:30 user nova-compute[75097]: STATIC:
Nov 14 16:03:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e
Nov 14 16:03:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:30 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:30 user nova-compute[75097]: No targets found.
Nov 14 16:03:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:30 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:30 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b671763-8acf-4400-a786-e94a0cce12f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a89f2-42e7-4659-bb9e-69a1fbe757b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:30 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:30 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:30 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:30 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:30 user nova-compute[75097]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e (non-flash)
Nov 14 16:03:30 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981bf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e'): ({'sdg'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Removing single pathed devices sdg {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b500b81-e30b-4dfb-980e-7b5507c323e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa8b66-d7c4-475d-82fd-f6e54fe15035]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Flushing IO for device /dev/sdg {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a22c7-4b37-4949-a168-f7ac0a406880]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 592445440 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbafbcc5-9a11-43d0-905a-0f1c0bf61076]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] SCSI volumes sdg have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[77abb59b-2670-4c46-a927-454cb1da1bcb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd42ab9-6517-4bc3-8a9e-5efb24e66f67]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260]
Nov 14 16:03:31 user nova-compute[75097]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:31 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5179a863-aaca-425c-aff5-4ba8b9da548e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[477797ac-60f4-425d-9c48-b8987d48ea68]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] <== disconnect_volume: return (374ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 679477248 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 825229312 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:32 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lazy-loading 'flavor' on Instance uuid e693c347-3d72-43eb-9a2f-77bee3d17210 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6bbeddf0-544e-4f01-9fac-aeab530bf458 tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.968s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 959447040 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErolULgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '423ae872-5f4c-4370-8130-1dcb018df80c'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:33 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3bb1c9-e2af-44ae-b79c-f94999d204df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:33 user nova-compute[75097]: No targets found.
Nov 14 16:03:33 user nova-compute[75097]: iSNS:
Nov 14 16:03:33 user nova-compute[75097]: No targets found.
Nov 14 16:03:33 user nova-compute[75097]: STATIC:
Nov 14 16:03:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c
Nov 14 16:03:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:33 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:33 user nova-compute[75097]: No targets found.
Nov 14 16:03:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:33 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:33 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[450f62e4-21cc-40d0-8f7b-3fd370f37d2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-987869b1-14ad-4cf4-a6dc-9e6e50dfd211 req-5761170d-53a2-4003-9d10-5afa040fe012 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-deleted-544ac7a9-ed32-4aad-8127-ca80d5c88853 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:33 user nova-compute[75097]: INFO nova.compute.manager [req-987869b1-14ad-4cf4-a6dc-9e6e50dfd211 req-5761170d-53a2-4003-9d10-5afa040fe012 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Neutron deleted interface 544ac7a9-ed32-4aad-8127-ca80d5c88853; detaching it from the instance and deleting it from the info cache
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-987869b1-14ad-4cf4-a6dc-9e6e50dfd211 req-5761170d-53a2-4003-9d10-5afa040fe012 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [{"id": "6e6c86c8-8570-44f1-998f-af9018b101f0", "address": "fa:16:3e:fd:d9:10", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e6c86c8-85", "ovs_interfaceid": "6e6c86c8-8570-44f1-998f-af9018b101f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "address": "fa:16:3e:a1:44:64", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74dfc01-37", "ovs_interfaceid": "b74dfc01-3793-4a14-9d8f-a32817ba1fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb02a90e-c3be-42ba-babb-d08381510228", "address": "fa:16:3e:39:98:e9", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02a90e-c3", "ovs_interfaceid": "eb02a90e-c3be-42ba-babb-d08381510228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40804154-1531-468e-9b27-fc17182abda7", "address": "fa:16:3e:bd:d7:da", "network": {"id": "e30827a8-754f-45a6-81ec-d360655dcff2", "bridge": "br-int", "label": "tempest-device-tagging-net1-2007530508", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40804154-15", "ovs_interfaceid": "40804154-1531-468e-9b27-fc17182abda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c68c49fb-3d40-4782-803e-81042732ab2a", "address": "fa:16:3e:3e:a6:a7", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68c49fb-3d", "ovs_interfaceid": "c68c49fb-3d40-4782-803e-81042732ab2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48eb4287-364b-4ade-8da0-517ec73d875a", "address": "fa:16:3e:0f:17:3d", "network": {"id": "f9631ab6-6886-4b8e-8797-3059b7c5ba74", "bridge": "br-int", "label": "tempest-device-tagging-net2-585442604", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f87eabd69961424da8fd9f3f265ca97b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48eb4287-36", "ovs_interfaceid": "48eb4287-364b-4ade-8da0-517ec73d875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[17641c69-c0e1-45cb-b569-52df874f1f62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:33 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:33 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:33 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:33 user nova-compute[75097]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c (non-flash)
Nov 14 16:03:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c'): ({'sdh'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Removing single pathed devices sdh {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[524510ff-8ff6-49b1-aca1-7f92a3ccddcd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-987869b1-14ad-4cf4-a6dc-9e6e50dfd211 req-5761170d-53a2-4003-9d10-5afa040fe012 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Detach interface failed, port_id=544ac7a9-ed32-4aad-8127-ca80d5c88853, reason: Instance 7581f138-f90b-4faa-aef0-e6bde1bf0ae5 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23708b99-1c26-43fb-8257-4d03e44e855e]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Flushing IO for device /dev/sdh {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[38975f5f-1c5c-454b-8194-dc63a8fc6e18]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:33 user nova-compute[75097]: INFO nova.compute.manager [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Terminating instance
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb464a-c51e-43d7-9b6d-fec95d091cb4]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] SCSI volumes sdh have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe16bd-72ed-4f07-9804-7a1e4c52dd81]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a79d19c-10ca-4487-b242-1576a6c46670]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260]
Nov 14 16:03:33 user nova-compute[75097]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423ae872-5f4c-4370-8130-1dcb018df80c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd65e6b-ba2f-4526-b79e-6813394972f7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] <== disconnect_volume: return (325ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd1b28242-ed4b-4ba8-8d18-d92ab06c46af', 'attached_at': '', 'detached_at': '', 'volume_id': 'b20e4661-b7cf-4373-a18a-4f2596f4175d', 'serial'} {{(pid=75097) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] swap_volume: removing Cinder connection for volume 423ae872-5f4c-4370-8130-1dcb018df80c {{(pid=75097) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-729c1611-ab0c-4680-996c-ffac7fbd67b7 req-6557869a-c19e-4631-9c86-2c3f0d29d3c7 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-vif-unplugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-729c1611-ab0c-4680-996c-ffac7fbd67b7 req-6557869a-c19e-4631-9c86-2c3f0d29d3c7 service nova] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-729c1611-ab0c-4680-996c-ffac7fbd67b7 req-6557869a-c19e-4631-9c86-2c3f0d29d3c7 service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-729c1611-ab0c-4680-996c-ffac7fbd67b7 req-6557869a-c19e-4631-9c86-2c3f0d29d3c7 service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-729c1611-ab0c-4680-996c-ffac7fbd67b7 req-6557869a-c19e-4631-9c86-2c3f0d29d3c7 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] No waiting events found dispatching network-vif-unplugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-729c1611-ab0c-4680-996c-ffac7fbd67b7 req-6557869a-c19e-4631-9c86-2c3f0d29d3c7 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-vif-unplugged-fa27e284-4304-44eb-8148-4458b4fceca2 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Instance destroyed successfully.
Nov 14 16:03:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lazy-loading 'resources' on Instance uuid e693c347-3d72-43eb-9a2f-77bee3d17210 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-531310718',display_name='tempest-AttachSCSIVolumeTestJSON-server-531310718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-531310718',id=8,image_ref='98d746a1-6477-46ea-bdf4-cdb4091f4e31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2T7E8b7zQjsJ8sMDPaTog6XQ2CLarUONHdSA0TLB5qSAQ3VjwUrAhk0piT1ONX3jzYPAdd0xb4LQNBqpT0kCidvt2yYbhpJz/tSJ4TCMqI6XViLzmS5HPExH+5A47XBg==',key_name='tempest-keypair-1009317236',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a589b842262349c2b6acb10fd493a684',ramdisk_id='',reservation_id='r-ngdosr0r',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98d746a1-6477-46ea-bdf4-cdb4091f4e31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1241104298',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1241104298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66cdf7473a9947eaaf1ff2ade73bf6c7',uuid=e693c347-3d72-43eb-9a2f-77bee3d17210,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Converting VIF {"id": "fa27e284-4304-44eb-8148-4458b4fceca2", "address": "fa:16:3e:6a:cf:75", "network": {"id": "03a40971-1385-4ba7-8167-626fd2d031f8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611645021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a589b842262349c2b6acb10fd493a684", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa27e284-43", "ovs_interfaceid": "fa27e284-4304-44eb-8148-4458b4fceca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG os_vif [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa27e284-43, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08a4b942-322f-4e5c-a4cb-c002a30b0883) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:34 user nova-compute[75097]: INFO os_vif [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:cf:75,bridge_name='br-int',has_traffic_filtering=True,id=fa27e284-4304-44eb-8148-4458b4fceca2,network=Network(03a40971-1385-4ba7-8167-626fd2d031f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa27e284-43')
Nov 14 16:03:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Deleting instance files /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210_del
Nov 14 16:03:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Deletion of /opt/stack/data/nova/instances/e693c347-3d72-43eb-9a2f-77bee3d17210_del complete
Nov 14 16:03:34 user nova-compute[75097]: INFO nova.compute.manager [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:34 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Took 4.75 seconds to deallocate network for instance.
Nov 14 16:03:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] swap_volume: Updating volume 423ae872-5f4c-4370-8130-1dcb018df80c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "jKUlkIdL", "auth_password": "Pv2b1qRl0EwBSr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "b20e4661-b7cf-4373-a18a-4f2596f4175d"}, "status": "reserved", "instance": "d1b28242-ed4b-4ba8-8d18-d92ab06c46af", "attached_at": "", "detached_at": "", "volume_id": "b20e4661-b7cf-4373-a18a-4f2596f4175d", "serial": "b20e4661-b7cf-4373-a18a-4f2596f4175d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b20e4661-b7cf-4373-a18a-4f2596f4175d', 'no_device': None, 'attachment_id': '37f1a3e0-247a-41c5-87ba-c1be3f809392'} {{(pid=75097) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-26bb3704-a652-4690-974d-2796d4a274ae tempest-TestVolumeSwap-954692501 tempest-TestVolumeSwap-954692501-project-admin] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.343s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-378d124a-5bab-4f71-ac30-04afba163813 req-6605b02a-bea3-4f41-ba4e-389ddf612206 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-deleted-eb02a90e-c3be-42ba-babb-d08381510228 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-378d124a-5bab-4f71-ac30-04afba163813 req-6605b02a-bea3-4f41-ba4e-389ddf612206 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-deleted-48eb4287-364b-4ade-8da0-517ec73d875a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-378d124a-5bab-4f71-ac30-04afba163813 req-6605b02a-bea3-4f41-ba4e-389ddf612206 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-deleted-c68c49fb-3d40-4782-803e-81042732ab2a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-378d124a-5bab-4f71-ac30-04afba163813 req-6605b02a-bea3-4f41-ba4e-389ddf612206 service nova] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Received event network-vif-deleted-40804154-1531-468e-9b27-fc17182abda7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-4cdfc857-00f7-479b-9382-58daf5122625 req-c5b113af-93de-4426-a5ea-5cb9a7ed4d95 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4cdfc857-00f7-479b-9382-58daf5122625 req-c5b113af-93de-4426-a5ea-5cb9a7ed4d95 service nova] Acquiring lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4cdfc857-00f7-479b-9382-58daf5122625 req-c5b113af-93de-4426-a5ea-5cb9a7ed4d95 service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4cdfc857-00f7-479b-9382-58daf5122625 req-c5b113af-93de-4426-a5ea-5cb9a7ed4d95 service nova] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-4cdfc857-00f7-479b-9382-58daf5122625 req-c5b113af-93de-4426-a5ea-5cb9a7ed4d95 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] No waiting events found dispatching network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:35 user nova-compute[75097]: WARNING nova.compute.manager [req-4cdfc857-00f7-479b-9382-58daf5122625 req-c5b113af-93de-4426-a5ea-5cb9a7ed4d95 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received unexpected event network-vif-plugged-fa27e284-4304-44eb-8148-4458b4fceca2 for instance with vm_state active and task_state deleting.
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-fdbc23be-d446-4749-b9f1-3829f9f763bf req-97084c9c-feed-42b3-90d0-0f0a01cf5ef9 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Received event network-vif-deleted-fa27e284-4304-44eb-8148-4458b4fceca2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:35 user nova-compute[75097]: INFO nova.compute.manager [req-fdbc23be-d446-4749-b9f1-3829f9f763bf req-97084c9c-feed-42b3-90d0-0f0a01cf5ef9 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Neutron deleted interface fa27e284-4304-44eb-8148-4458b4fceca2; detaching it from the instance and deleting it from the info cache
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.network.neutron [req-fdbc23be-d446-4749-b9f1-3829f9f763bf req-97084c9c-feed-42b3-90d0-0f0a01cf5ef9 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:35 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Took 1.52 seconds to deallocate network for instance.
Nov 14 16:03:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-fdbc23be-d446-4749-b9f1-3829f9f763bf req-97084c9c-feed-42b3-90d0-0f0a01cf5ef9 service nova] [instance: e693c347-3d72-43eb-9a2f-77bee3d17210] Detach interface failed, port_id=fa27e284-4304-44eb-8148-4458b4fceca2, reason: Instance e693c347-3d72-43eb-9a2f-77bee3d17210 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:35 user nova-compute[75097]: INFO nova.compute.manager [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Detaching volume b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:36 user nova-compute[75097]: INFO nova.virt.block_device [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Attempting to driver detach volume b20e4661-b7cf-4373-a18a-4f2596f4175d from mountpoint /dev/vdb
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Attempting to detach device vdb from instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:36 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:36 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:03:36 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:36 user nova-compute[75097]:   <serial>b20e4661-b7cf-4373-a18a-4f2596f4175d</serial>
Nov 14 16:03:36 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:03:36 user nova-compute[75097]: </disk>
Nov 14 16:03:36 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Successfully detached device vdb from instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af from the persistent domain config.
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:03:36 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:03:36 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:03:36 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:03:36 user nova-compute[75097]:   <serial>b20e4661-b7cf-4373-a18a-4f2596f4175d</serial>
Nov 14 16:03:36 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:03:36 user nova-compute[75097]: </disk>
Nov 14 16:03:36 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.553s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:36 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Deleted allocations for instance e693c347-3d72-43eb-9a2f-77bee3d17210
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33baa0ce-0a1b-4893-9fe7-f309c08fdcbd tempest-AttachSCSIVolumeTestJSON-1241104298 tempest-AttachSCSIVolumeTestJSON-1241104298-project-member] Lock "e693c347-3d72-43eb-9a2f-77bee3d17210" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.249s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:36 user nova-compute[75097]: INFO nova.compute.manager [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] [instance: 7581f138-f90b-4faa-aef0-e6bde1bf0ae5] Took 2.39 seconds to detach 3 volumes for instance.
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:37 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Deleted allocations for instance 7581f138-f90b-4faa-aef0-e6bde1bf0ae5
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:37 user nova-compute[75097]: INFO nova.compute.manager [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Terminating instance
Nov 14 16:03:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a8a26ab7-746d-428d-bd2d-2478cfde6884 tempest-TaggedBootDevicesTest-157690292 tempest-TaggedBootDevicesTest-157690292-project-member] Lock "7581f138-f90b-4faa-aef0-e6bde1bf0ae5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.535s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33225f43-00eb-4511-b81e-c92e5e617898 is timed out.
Nov 14 16:03:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Successfully detached device vdb from instance 33225f43-00eb-4511-b81e-c92e5e617898 from the live domain config.
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIOGdmZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:38 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553c3b0-e5cf-4e9f-b581-6eba7c157f11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:38 user nova-compute[75097]: No targets found.
Nov 14 16:03:38 user nova-compute[75097]: iSNS:
Nov 14 16:03:38 user nova-compute[75097]: No targets found.
Nov 14 16:03:38 user nova-compute[75097]: STATIC:
Nov 14 16:03:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a
Nov 14 16:03:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:38 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:38 user nova-compute[75097]: No targets found.
Nov 14 16:03:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:38 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:38 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-6e6d2517-3e2c-4ed7-b3ac-7eb4a7f1969e req-52cc6c9e-d6cd-4b48-80f0-fd9f82f65c31 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-vif-unplugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6e6d2517-3e2c-4ed7-b3ac-7eb4a7f1969e req-52cc6c9e-d6cd-4b48-80f0-fd9f82f65c31 service nova] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6e6d2517-3e2c-4ed7-b3ac-7eb4a7f1969e req-52cc6c9e-d6cd-4b48-80f0-fd9f82f65c31 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6e6d2517-3e2c-4ed7-b3ac-7eb4a7f1969e req-52cc6c9e-d6cd-4b48-80f0-fd9f82f65c31 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-6e6d2517-3e2c-4ed7-b3ac-7eb4a7f1969e req-52cc6c9e-d6cd-4b48-80f0-fd9f82f65c31 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] No waiting events found dispatching network-vif-unplugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-6e6d2517-3e2c-4ed7-b3ac-7eb4a7f1969e req-52cc6c9e-d6cd-4b48-80f0-fd9f82f65c31 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-vif-unplugged-e06855db-2643-41f1-9412-8d85f8611875 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Instance destroyed successfully.
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.objects.instance [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lazy-loading 'resources' on Instance uuid 94260c24-3457-4e7f-98a7-30cbbb4ae628 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f203cb-0ae4-4b95-b83c-0d97ecea6fbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1384670079',display_name='tempest-VolumesNegativeTest-instance-1384670079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1384670079',id=13,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13f5ead61764b4bab7304cd8c42d489',ramdisk_id='',reservation_id='r-ib1n6aps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-458602789',owner_user_name='tempest-VolumesNegativeTest-458602789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:01:55Z,user_data=None,user_id='70395fd6cc404605b59c004bc5c12fed',uuid=94260c24-3457-4e7f-98a7-30cbbb4ae628,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Converting VIF {"id": "e06855db-2643-41f1-9412-8d85f8611875", "address": "fa:16:3e:dc:26:9b", "network": {"id": "ddeb7e54-1e88-486c-8406-60b8f98e21c2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ec544b180a348d48d977f22b9624789", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape06855db-26", "ovs_interfaceid": "e06855db-2643-41f1-9412-8d85f8611875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_vif [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape06855db-26, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[891f7d58-29b0-41ad-a181-92ce7b20db00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:38 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a (non-flash)
Nov 14 16:03:38 user nova-compute[75097]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981be5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a'): ({'sdi'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Removing single pathed devices sdi {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3506cd6b-8bf0-4ded-9531-9f33fcc2d6c4) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.097s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[71916281-2c4d-4153-b15e-28e43bbe4222]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: INFO os_vif [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:9b,bridge_name='br-int',has_traffic_filtering=True,id=e06855db-2643-41f1-9412-8d85f8611875,network=Network(ddeb7e54-1e88-486c-8406-60b8f98e21c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape06855db-26')
Nov 14 16:03:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Deleting instance files /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628_del
Nov 14 16:03:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Deletion of /opt/stack/data/nova/instances/94260c24-3457-4e7f-98a7-30cbbb4ae628_del complete
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc36cb6f-c838-4aa9-b2d8-69d4fc6e8dc3]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Flushing IO for device /dev/sdi {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0887e-47d4-4d09-a210-5d3fd4f270d4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8074df60-54e4-45f8-a009-bc36e21e4085]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] SCSI volumes sdi have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: INFO nova.compute.manager [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[697a5218-87d7-4c7c-8f6a-667268ba63bc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5f9954-9c44-4942-ad5b-27d4bea10b68]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260]
Nov 14 16:03:39 user nova-compute[75097]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:39 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:03:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7143MB free_disk=25.336105346679688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32491725-5694-4194-b0db-10d28b444c4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e0a01-43cb-40ac-8451-de595ed91f03]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.843s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] <== disconnect_volume: return (845ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 34098dea-702d-454d-af5e-35b51cac9bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 33225f43-00eb-4511-b81e-c92e5e617898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94260c24-3457-4e7f-98a7-30cbbb4ae628 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance dba4bc8c-6e06-4753-8d95-81d55520668d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:39 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Took 0.85 seconds to deallocate network for instance.
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.072s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lazy-loading 'flavor' on Instance uuid 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f7a49edf-4317-4b22-98a0-d4c78bb65be7 tempest-VolumesAssistedSnapshotsTest-771237415 tempest-VolumesAssistedSnapshotsTest-771237415-project-admin] Lock "33225f43-00eb-4511-b81e-c92e5e617898" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.204s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:40 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Deleted allocations for instance 94260c24-3457-4e7f-98a7-30cbbb4ae628
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01154816-60e2-42e0-a809-57d90cc8f975 tempest-VolumesNegativeTest-458602789 tempest-VolumesNegativeTest-458602789-project-member] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.527s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] Acquiring lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] Lock "94260c24-3457-4e7f-98a7-30cbbb4ae628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] No waiting events found dispatching network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:40 user nova-compute[75097]: WARNING nova.compute.manager [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received unexpected event network-vif-plugged-e06855db-2643-41f1-9412-8d85f8611875 for instance with vm_state deleted and task_state None.
Nov 14 16:03:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-0d127177-3843-46fe-a8bc-8cf8fd3404b5 req-3d49082f-990c-4de0-b380-b0a3b6183009 service nova] [instance: 94260c24-3457-4e7f-98a7-30cbbb4ae628] Received event network-vif-deleted-e06855db-2643-41f1-9412-8d85f8611875 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:03:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:03:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:03:49 user nova-compute[75097]: INFO nova.compute.claims [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Claim successful on node user
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:03:49 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.policy [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5f35d919f944a3984a538daa57fef3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7b3f9a7c5942a395e55f73157a7dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:03:49 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Creating image(s)
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk 1073741824" returned: 0 in 0.043s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Successfully created port: 0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Cannot resize image /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Ensure instance console log exists: /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Successfully updated port: 0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquired lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-changed-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Refreshing instance network info cache due to event network-changed-0297ecfb-7446-4658-8ff2-de675bb1d52d. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:03:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] Acquiring lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Releasing lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Instance network_info: |[{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] Acquired lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Refreshing network info cache for port 0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Start _get_guest_xml network_info=[{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:03:51 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:03:51 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:03:51 user nova-compute[75097]:   <uuid>9f739f81-f9a3-4b90-a99d-12bd82c3602d</uuid>
Nov 14 16:03:51 user nova-compute[75097]:   <name>instance-0000000f</name>
Nov 14 16:03:51 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:03:51 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:03:51 user nova-compute[75097]:   <metadata>
Nov 14 16:03:51 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:03:51 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:03:51 user nova-compute[75097]:       <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:03:51 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:03:51</nova:creationTime>
Nov 14 16:03:51 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:03:51 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:03:51 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:03:51 user nova-compute[75097]:       <nova:owner>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:03:51 user nova-compute[75097]:       </nova:owner>
Nov 14 16:03:51 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:03:51 user nova-compute[75097]:       <nova:ports>
Nov 14 16:03:51 user nova-compute[75097]:         <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:03:51 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:03:51 user nova-compute[75097]:         </nova:port>
Nov 14 16:03:51 user nova-compute[75097]:       </nova:ports>
Nov 14 16:03:51 user nova-compute[75097]:     </nova:instance>
Nov 14 16:03:51 user nova-compute[75097]:   </metadata>
Nov 14 16:03:51 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:03:51 user nova-compute[75097]:     <system>
Nov 14 16:03:51 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:03:51 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:03:51 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:03:51 user nova-compute[75097]:       <entry name="serial">9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:03:51 user nova-compute[75097]:       <entry name="uuid">9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:03:51 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:03:51 user nova-compute[75097]:     </system>
Nov 14 16:03:51 user nova-compute[75097]:   </sysinfo>
Nov 14 16:03:51 user nova-compute[75097]:   <os>
Nov 14 16:03:51 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:03:51 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:03:51 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:03:51 user nova-compute[75097]:   </os>
Nov 14 16:03:51 user nova-compute[75097]:   <features>
Nov 14 16:03:51 user nova-compute[75097]:     <acpi/>
Nov 14 16:03:51 user nova-compute[75097]:     <apic/>
Nov 14 16:03:51 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:03:51 user nova-compute[75097]:   </features>
Nov 14 16:03:51 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:03:51 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:03:51 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:03:51 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:03:51 user nova-compute[75097]:   </clock>
Nov 14 16:03:51 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:03:51 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:03:51 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:03:51 user nova-compute[75097]:   </cpu>
Nov 14 16:03:51 user nova-compute[75097]:   <devices>
Nov 14 16:03:51 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:03:51 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:03:51 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk"/>
Nov 14 16:03:51 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:03:51 user nova-compute[75097]:     </disk>
Nov 14 16:03:51 user nova-compute[75097]:     <disk type="file" device="cdrom">
Nov 14 16:03:51 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 16:03:51 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config"/>
Nov 14 16:03:51 user nova-compute[75097]:       <target dev="hda" bus="ide"/>
Nov 14 16:03:51 user nova-compute[75097]:     </disk>
Nov 14 16:03:51 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:03:51 user nova-compute[75097]:       <mac address="fa:16:3e:6b:82:67"/>
Nov 14 16:03:51 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:03:51 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:03:51 user nova-compute[75097]:       <target dev="tap0297ecfb-74"/>
Nov 14 16:03:51 user nova-compute[75097]:     </interface>
Nov 14 16:03:51 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:03:51 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log" append="off"/>
Nov 14 16:03:51 user nova-compute[75097]:     </serial>
Nov 14 16:03:51 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:03:51 user nova-compute[75097]:     <video>
Nov 14 16:03:51 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:03:51 user nova-compute[75097]:     </video>
Nov 14 16:03:51 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:03:51 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:03:51 user nova-compute[75097]:     </rng>
Nov 14 16:03:51 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:03:51 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:03:51 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:03:51 user nova-compute[75097]:     </memballoon>
Nov 14 16:03:51 user nova-compute[75097]:   </devices>
Nov 14 16:03:51 user nova-compute[75097]: </domain>
Nov 14 16:03:51 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG os_vif [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c0faddf-5433-582b-8aea-71394e46ac5a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0297ecfb-74, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0297ecfb-74, col_values=(('qos', UUID('e835a3e5-7eb2-40fe-9b78-f344264b8482')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0297ecfb-74, col_values=(('external_ids', {'iface-id': '0297ecfb-7446-4658-8ff2-de675bb1d52d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:82:67', 'vm-uuid': '9f739f81-f9a3-4b90-a99d-12bd82c3602d'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:51 user nova-compute[75097]: INFO os_vif [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74')
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No BDM found with device name hda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No VIF found with MAC fa:16:3e:6b:82:67, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:03:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Using config drive
Nov 14 16:03:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Creating config drive at /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config
Nov 14 16:03:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd18sa_oa {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd18sa_oa" returned: 0 in 0.051s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updated VIF entry in instance network info cache for port 0297ecfb-7446-4658-8ff2-de675bb1d52d. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9086a805-3111-49d4-a32f-874373ad2461 req-e87cc493-12ac-4bc0-b854-a0e298b1a826 service nova] Releasing lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-b87d0e5d-9fc3-4012-9904-7015aa82773a req-9416557e-0306-4983-90cb-de9fb3105e9c service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b87d0e5d-9fc3-4012-9904-7015aa82773a req-9416557e-0306-4983-90cb-de9fb3105e9c service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b87d0e5d-9fc3-4012-9904-7015aa82773a req-9416557e-0306-4983-90cb-de9fb3105e9c service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b87d0e5d-9fc3-4012-9904-7015aa82773a req-9416557e-0306-4983-90cb-de9fb3105e9c service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-b87d0e5d-9fc3-4012-9904-7015aa82773a req-9416557e-0306-4983-90cb-de9fb3105e9c service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:53 user nova-compute[75097]: WARNING nova.compute.manager [req-b87d0e5d-9fc3-4012-9904-7015aa82773a req-9416557e-0306-4983-90cb-de9fb3105e9c service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state building and task_state spawning.
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:03:53 user nova-compute[75097]: INFO nova.compute.claims [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Claim successful on node user
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:03:53 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:03:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.policy [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '403e6a373c874a42b09067107b75355e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f76214f6904b62b3b8987610bc22c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:03:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Creating image(s)
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "/opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "/opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Successfully created port: 17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.228s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk 1073741824" returned: 0 in 0.049s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Cannot resize image /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Ensure instance console log exists: /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Successfully updated port: 17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "refresh_cache-d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquired lock "refresh_cache-d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-changed-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Refreshing instance network info cache due to event network-changed-17bc8bee-dd61-40f2-b033-8c7e550a6acf. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] Acquiring lock "refresh_cache-d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-084b000a-da13-4103-83e7-19ec36428228 req-f5bd2a6b-1135-4c41-b826-c6b65a8b79b3 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-084b000a-da13-4103-83e7-19ec36428228 req-f5bd2a6b-1135-4c41-b826-c6b65a8b79b3 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-084b000a-da13-4103-83e7-19ec36428228 req-f5bd2a6b-1135-4c41-b826-c6b65a8b79b3 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-084b000a-da13-4103-83e7-19ec36428228 req-f5bd2a6b-1135-4c41-b826-c6b65a8b79b3 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-084b000a-da13-4103-83e7-19ec36428228 req-f5bd2a6b-1135-4c41-b826-c6b65a8b79b3 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:55 user nova-compute[75097]: WARNING nova.compute.manager [req-084b000a-da13-4103-83e7-19ec36428228 req-f5bd2a6b-1135-4c41-b826-c6b65a8b79b3 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state building and task_state spawning.
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:03:55 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Instance spawned successfully.
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Updating instance_info_cache with network_info: [{"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Releasing lock "refresh_cache-d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Instance network_info: |[{"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] Acquired lock "refresh_cache-d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.neutron [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Refreshing network info cache for port 17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Start _get_guest_xml network_info=[{"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:03:55 user nova-compute[75097]: INFO nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:03:55 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:03:55 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1359421202',display_name='tempest-VolumesAdminNegativeTest-server-1359421202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1359421202',id=16,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1f76214f6904b62b3b8987610bc22c5',ramdisk_id='',reservation_id='r-zzjic7ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1445801438',owner_user_name='tempest-VolumesAdminNegativeTest-1445801438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:03:54Z,user_data=None,user_id='403e6a373c874a42b09067107b75355e',uuid=d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converting VIF {"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:03:55 user nova-compute[75097]:   <uuid>d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8</uuid>
Nov 14 16:03:55 user nova-compute[75097]:   <name>instance-00000010</name>
Nov 14 16:03:55 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:03:55 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:03:55 user nova-compute[75097]:   <metadata>
Nov 14 16:03:55 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:03:55 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:03:55 user nova-compute[75097]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1359421202</nova:name>
Nov 14 16:03:55 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:03:55</nova:creationTime>
Nov 14 16:03:55 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:03:55 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:03:55 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:03:55 user nova-compute[75097]:       <nova:owner>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:user uuid="403e6a373c874a42b09067107b75355e">tempest-VolumesAdminNegativeTest-1445801438-project-member</nova:user>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:project uuid="d1f76214f6904b62b3b8987610bc22c5">tempest-VolumesAdminNegativeTest-1445801438</nova:project>
Nov 14 16:03:55 user nova-compute[75097]:       </nova:owner>
Nov 14 16:03:55 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:03:55 user nova-compute[75097]:       <nova:ports>
Nov 14 16:03:55 user nova-compute[75097]:         <nova:port uuid="17bc8bee-dd61-40f2-b033-8c7e550a6acf">
Nov 14 16:03:55 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 16:03:55 user nova-compute[75097]:         </nova:port>
Nov 14 16:03:55 user nova-compute[75097]:       </nova:ports>
Nov 14 16:03:55 user nova-compute[75097]:     </nova:instance>
Nov 14 16:03:55 user nova-compute[75097]:   </metadata>
Nov 14 16:03:55 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:03:55 user nova-compute[75097]:     <system>
Nov 14 16:03:55 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:03:55 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:03:55 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:03:55 user nova-compute[75097]:       <entry name="serial">d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8</entry>
Nov 14 16:03:55 user nova-compute[75097]:       <entry name="uuid">d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8</entry>
Nov 14 16:03:55 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:03:55 user nova-compute[75097]:     </system>
Nov 14 16:03:55 user nova-compute[75097]:   </sysinfo>
Nov 14 16:03:55 user nova-compute[75097]:   <os>
Nov 14 16:03:55 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:03:55 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:03:55 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:03:55 user nova-compute[75097]:   </os>
Nov 14 16:03:55 user nova-compute[75097]:   <features>
Nov 14 16:03:55 user nova-compute[75097]:     <acpi/>
Nov 14 16:03:55 user nova-compute[75097]:     <apic/>
Nov 14 16:03:55 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:03:55 user nova-compute[75097]:   </features>
Nov 14 16:03:55 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:03:55 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:03:55 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:03:55 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:03:55 user nova-compute[75097]:   </clock>
Nov 14 16:03:55 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:03:55 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:03:55 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:03:55 user nova-compute[75097]:   </cpu>
Nov 14 16:03:55 user nova-compute[75097]:   <devices>
Nov 14 16:03:55 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:03:55 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:03:55 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk"/>
Nov 14 16:03:55 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:03:55 user nova-compute[75097]:     </disk>
Nov 14 16:03:55 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:03:55 user nova-compute[75097]:       <mac address="fa:16:3e:8a:03:3a"/>
Nov 14 16:03:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:03:55 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:03:55 user nova-compute[75097]:       <target dev="tap17bc8bee-dd"/>
Nov 14 16:03:55 user nova-compute[75097]:     </interface>
Nov 14 16:03:55 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:03:55 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/console.log" append="off"/>
Nov 14 16:03:55 user nova-compute[75097]:     </serial>
Nov 14 16:03:55 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:03:55 user nova-compute[75097]:     <video>
Nov 14 16:03:55 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:03:55 user nova-compute[75097]:     </video>
Nov 14 16:03:55 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:03:55 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:03:55 user nova-compute[75097]:     </rng>
Nov 14 16:03:55 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:03:55 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:03:55 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:03:55 user nova-compute[75097]:     </memballoon>
Nov 14 16:03:55 user nova-compute[75097]:   </devices>
Nov 14 16:03:55 user nova-compute[75097]: </domain>
Nov 14 16:03:55 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1359421202',display_name='tempest-VolumesAdminNegativeTest-server-1359421202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1359421202',id=16,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1f76214f6904b62b3b8987610bc22c5',ramdisk_id='',reservation_id='r-zzjic7ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1445801438',owner_user_name='tempest-VolumesAdminNegativeTest-1445801438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:03:54Z,user_data=None,user_id='403e6a373c874a42b09067107b75355e',uuid=d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converting VIF {"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG os_vif [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b467612-7b6b-55cd-a2ee-4df511d21463', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: INFO nova.compute.manager [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Took 6.67 seconds to build instance.
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17bc8bee-dd, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17bc8bee-dd, col_values=(('qos', UUID('88b81ce0-df97-44ff-b21c-88e074165819')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17bc8bee-dd, col_values=(('external_ids', {'iface-id': '17bc8bee-dd61-40f2-b033-8c7e550a6acf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:03:3a', 'vm-uuid': 'd5e1bfb1-dc91-4fc4-8803-c931d12b6ed8'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:55 user nova-compute[75097]: INFO os_vif [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd')
Nov 14 16:03:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cd25ea74-6c9e-44e3-a786-29745c01fd9d tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.781s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] No VIF found with MAC fa:16:3e:8a:03:3a, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG nova.network.neutron [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Updated VIF entry in instance network info cache for port 17bc8bee-dd61-40f2-b033-8c7e550a6acf. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG nova.network.neutron [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Updating instance_info_cache with network_info: [{"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2d25bab5-dc87-417b-b919-2ad8a09c38b0 req-cbc40b28-9f93-4ed3-965d-576b3ab269fa service nova] Releasing lock "refresh_cache-d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:03:56 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af is timed out.
Nov 14 16:03:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Successfully detached device vdb from instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af from the live domain config.
Nov 14 16:03:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKUlkIdL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'b20e4661-b7cf-4373-a18a-4f2596f4175d'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:03:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[774364d5-002f-43ea-b4e0-075ddf88654b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:03:56 user nova-compute[75097]: No targets found.
Nov 14 16:03:56 user nova-compute[75097]: iSNS:
Nov 14 16:03:56 user nova-compute[75097]: No targets found.
Nov 14 16:03:56 user nova-compute[75097]: STATIC:
Nov 14 16:03:56 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d
Nov 14 16:03:56 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:03:56 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:03:56 user nova-compute[75097]: FIRMWARE:
Nov 14 16:03:56 user nova-compute[75097]: No targets found.
Nov 14 16:03:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:03:56 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:03:56 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e565e8-ec33-4a73-ae92-c292671093b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[922deac4-a897-4163-895d-d75059605672]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d (non-flash)
Nov 14 16:03:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9825d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc75ab-fcb9-4cac-a263-484505b1b8a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a722d11b-826c-475b-ac17-e0d5b1fdc4fb]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e402419-0e19-4d0e-b9ad-8464a180213f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc01f0f-4425-4819-b616-52e8c6235fdb]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[92219a8c-2b97-42af-92f6-b5a9a3eecbb6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d81da4-8475-4ec5-a60a-dbb93cae1cb3]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260]
Nov 14 16:03:56 user nova-compute[75097]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d, portal: 172.16.0.220,3260] successful.
Nov 14 16:03:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b20e4661-b7cf-4373-a18a-4f2596f4175d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aff38f-e6c9-44ba-80ad-a0f282826ef2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] <== disconnect_volume: return (268ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:03:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-b8a9748c-3a20-4a62-aa45-77187a4ab721 req-67f84dc7-274d-43a5-a3e5-570fa0a66da7 service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b8a9748c-3a20-4a62-aa45-77187a4ab721 req-67f84dc7-274d-43a5-a3e5-570fa0a66da7 service nova] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b8a9748c-3a20-4a62-aa45-77187a4ab721 req-67f84dc7-274d-43a5-a3e5-570fa0a66da7 service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b8a9748c-3a20-4a62-aa45-77187a4ab721 req-67f84dc7-274d-43a5-a3e5-570fa0a66da7 service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-b8a9748c-3a20-4a62-aa45-77187a4ab721 req-67f84dc7-274d-43a5-a3e5-570fa0a66da7 service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] No waiting events found dispatching network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:57 user nova-compute[75097]: WARNING nova.compute.manager [req-b8a9748c-3a20-4a62-aa45-77187a4ab721 req-67f84dc7-274d-43a5-a3e5-570fa0a66da7 service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received unexpected event network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf for instance with vm_state building and task_state spawning.
Nov 14 16:03:57 user nova-compute[75097]: DEBUG nova.objects.instance [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lazy-loading 'flavor' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:03:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-13314ce1-ba2e-4060-8b0b-08e86ed5c6cb tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:03:59 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Instance spawned successfully.
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:03:59 user nova-compute[75097]: INFO nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-0a7d4e4f-7d7e-4683-a2a1-e3cf3bdf6c99 req-3bfbdd19-6bfb-4704-a042-312164274a29 service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0a7d4e4f-7d7e-4683-a2a1-e3cf3bdf6c99 req-3bfbdd19-6bfb-4704-a042-312164274a29 service nova] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0a7d4e4f-7d7e-4683-a2a1-e3cf3bdf6c99 req-3bfbdd19-6bfb-4704-a042-312164274a29 service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0a7d4e4f-7d7e-4683-a2a1-e3cf3bdf6c99 req-3bfbdd19-6bfb-4704-a042-312164274a29 service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:03:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-0a7d4e4f-7d7e-4683-a2a1-e3cf3bdf6c99 req-3bfbdd19-6bfb-4704-a042-312164274a29 service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] No waiting events found dispatching network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:03:59 user nova-compute[75097]: WARNING nova.compute.manager [req-0a7d4e4f-7d7e-4683-a2a1-e3cf3bdf6c99 req-3bfbdd19-6bfb-4704-a042-312164274a29 service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received unexpected event network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf for instance with vm_state building and task_state spawning.
Nov 14 16:03:59 user nova-compute[75097]: INFO nova.compute.manager [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Took 6.13 seconds to build instance.
Nov 14 16:03:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4d0c5439-6d9b-41ec-b045-f62be5bef532 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.261s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "33225f43-00eb-4511-b81e-c92e5e617898" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:10 user nova-compute[75097]: INFO nova.compute.manager [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Terminating instance
Nov 14 16:04:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-720426a1-a9a7-487f-b0d0-cfd50f5769fb req-9f1b1087-44ef-4219-b992-a1237b1cdb0b service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-vif-unplugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-720426a1-a9a7-487f-b0d0-cfd50f5769fb req-9f1b1087-44ef-4219-b992-a1237b1cdb0b service nova] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-720426a1-a9a7-487f-b0d0-cfd50f5769fb req-9f1b1087-44ef-4219-b992-a1237b1cdb0b service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-720426a1-a9a7-487f-b0d0-cfd50f5769fb req-9f1b1087-44ef-4219-b992-a1237b1cdb0b service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-720426a1-a9a7-487f-b0d0-cfd50f5769fb req-9f1b1087-44ef-4219-b992-a1237b1cdb0b service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] No waiting events found dispatching network-vif-unplugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-720426a1-a9a7-487f-b0d0-cfd50f5769fb req-9f1b1087-44ef-4219-b992-a1237b1cdb0b service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-vif-unplugged-81879656-ed89-46e1-ba5b-55768c540167 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Instance destroyed successfully.
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lazy-loading 'resources' on Instance uuid 33225f43-00eb-4511-b81e-c92e5e617898 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-214608853',display_name='tempest-VolumesAssistedSnapshotsTest-server-214608853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-214608853',id=10,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3rFjTZJqLWjlRUcsYSJZaY6kTxs+emPkAHc7Qqi9qTg9TzRIw7cwSslPsPTtFY7oVCfLxr5wBp00nykiNCRSqm+kW8hCbiLRCZiqRm4LCViRaYl580iS0X2MJ0PIpnRg==',key_name='tempest-keypair-1411274199',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:01:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f33afa19cbde452dbd785d0936bd2601',ramdisk_id='',reservation_id='r-jz0t9rdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-842364608',owner_user_name='tempest-VolumesAssistedSnapshotsTest-842364608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf3c1d42f7f426e8430eebf922f1ab3',uuid=33225f43-00eb-4511-b81e-c92e5e617898,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Converting VIF {"id": "81879656-ed89-46e1-ba5b-55768c540167", "address": "fa:16:3e:2e:b2:39", "network": {"id": "7401f3c4-104f-4c08-83d1-c5ed514f2ede", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2043697556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f33afa19cbde452dbd785d0936bd2601", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81879656-ed", "ovs_interfaceid": "81879656-ed89-46e1-ba5b-55768c540167", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG os_vif [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81879656-ed, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f2b8e7b-732e-4080-af14-5e4433e124fc) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:11 user nova-compute[75097]: INFO os_vif [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:b2:39,bridge_name='br-int',has_traffic_filtering=True,id=81879656-ed89-46e1-ba5b-55768c540167,network=Network(7401f3c4-104f-4c08-83d1-c5ed514f2ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81879656-ed')
Nov 14 16:04:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Deleting instance files /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898_del
Nov 14 16:04:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Deletion of /opt/stack/data/nova/instances/33225f43-00eb-4511-b81e-c92e5e617898_del complete
Nov 14 16:04:11 user nova-compute[75097]: INFO nova.compute.manager [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 16:04:11 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:11 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Took 0.75 seconds to deallocate network for instance.
Nov 14 16:04:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-6da310a1-428a-43af-b4f7-4be673a29ba6 req-21a5ddd8-d410-4b06-9e5e-eff5512eae95 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-vif-deleted-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:12 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Deleted allocations for instance 33225f43-00eb-4511-b81e-c92e5e617898
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eae0d195-3a54-4197-9170-320ec9f111da tempest-VolumesAssistedSnapshotsTest-842364608 tempest-VolumesAssistedSnapshotsTest-842364608-project-member] Lock "33225f43-00eb-4511-b81e-c92e5e617898" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-2041c199-38d2-4524-865c-c4675593ecfc req-dbd73800-482f-49c9-91cb-a63e78475764 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received event network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2041c199-38d2-4524-865c-c4675593ecfc req-dbd73800-482f-49c9-91cb-a63e78475764 service nova] Acquiring lock "33225f43-00eb-4511-b81e-c92e5e617898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2041c199-38d2-4524-865c-c4675593ecfc req-dbd73800-482f-49c9-91cb-a63e78475764 service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2041c199-38d2-4524-865c-c4675593ecfc req-dbd73800-482f-49c9-91cb-a63e78475764 service nova] Lock "33225f43-00eb-4511-b81e-c92e5e617898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-2041c199-38d2-4524-865c-c4675593ecfc req-dbd73800-482f-49c9-91cb-a63e78475764 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] No waiting events found dispatching network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:12 user nova-compute[75097]: WARNING nova.compute.manager [req-2041c199-38d2-4524-865c-c4675593ecfc req-dbd73800-482f-49c9-91cb-a63e78475764 service nova] [instance: 33225f43-00eb-4511-b81e-c92e5e617898] Received unexpected event network-vif-plugged-81879656-ed89-46e1-ba5b-55768c540167 for instance with vm_state deleted and task_state None.
Nov 14 16:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:17 user nova-compute[75097]: INFO nova.compute.manager [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Terminating instance
Nov 14 16:04:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-edb12728-426f-4b3e-a99c-e5c66ecf1e1c req-85d7847b-1537-4450-b1a1-0dcf06284252 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-vif-unplugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-edb12728-426f-4b3e-a99c-e5c66ecf1e1c req-85d7847b-1537-4450-b1a1-0dcf06284252 service nova] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-edb12728-426f-4b3e-a99c-e5c66ecf1e1c req-85d7847b-1537-4450-b1a1-0dcf06284252 service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-edb12728-426f-4b3e-a99c-e5c66ecf1e1c req-85d7847b-1537-4450-b1a1-0dcf06284252 service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-edb12728-426f-4b3e-a99c-e5c66ecf1e1c req-85d7847b-1537-4450-b1a1-0dcf06284252 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] No waiting events found dispatching network-vif-unplugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-edb12728-426f-4b3e-a99c-e5c66ecf1e1c req-85d7847b-1537-4450-b1a1-0dcf06284252 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-vif-unplugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:04:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Instance destroyed successfully.
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lazy-loading 'resources' on Instance uuid dba4bc8c-6e06-4753-8d95-81d55520668d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1925355705',display_name='tempest-ServersNegativeTestJSON-server-1925355705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1925355705',id=14,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d925bff9b1de4d35bc1a0c84437c4a88',ramdisk_id='',reservation_id='r-vq3d47xh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-912372315',owner_user_name='tempest-ServersNegativeTestJSON-912372315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:36Z,user_data=None,user_id='d0c8e2c01a9a4defa352c3e3fcbb4f8c',uuid=dba4bc8c-6e06-4753-8d95-81d55520668d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converting VIF {"id": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "address": "fa:16:3e:11:8c:d0", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075fe1bc-bc", "ovs_interfaceid": "075fe1bc-bc02-41e6-9ec7-0cb65a2a2510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG os_vif [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap075fe1bc-bc, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8c7c0ae-6448-4d35-9b87-2a0d897508a5) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:18 user nova-compute[75097]: INFO os_vif [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8c:d0,bridge_name='br-int',has_traffic_filtering=True,id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075fe1bc-bc')
Nov 14 16:04:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Deleting instance files /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d_del
Nov 14 16:04:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Deletion of /opt/stack/data/nova/instances/dba4bc8c-6e06-4753-8d95-81d55520668d_del complete
Nov 14 16:04:18 user nova-compute[75097]: INFO nova.compute.manager [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 16:04:18 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:04:18 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:19 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Took 0.80 seconds to deallocate network for instance.
Nov 14 16:04:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-ef963c7a-f32d-4339-b8d5-3e6074a65c1e req-fa557d6f-a004-4892-bfc1-6f2b3f3e870f service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-vif-deleted-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:19 user nova-compute[75097]: INFO nova.compute.manager [req-ef963c7a-f32d-4339-b8d5-3e6074a65c1e req-fa557d6f-a004-4892-bfc1-6f2b3f3e870f service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Neutron deleted interface 075fe1bc-bc02-41e6-9ec7-0cb65a2a2510; detaching it from the instance and deleting it from the info cache
Nov 14 16:04:19 user nova-compute[75097]: DEBUG nova.network.neutron [req-ef963c7a-f32d-4339-b8d5-3e6074a65c1e req-fa557d6f-a004-4892-bfc1-6f2b3f3e870f service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-ef963c7a-f32d-4339-b8d5-3e6074a65c1e req-fa557d6f-a004-4892-bfc1-6f2b3f3e870f service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Detach interface failed, port_id=075fe1bc-bc02-41e6-9ec7-0cb65a2a2510, reason: Instance dba4bc8c-6e06-4753-8d95-81d55520668d could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:04:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:19 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Deleted allocations for instance dba4bc8c-6e06-4753-8d95-81d55520668d
Nov 14 16:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29383315-82e9-4ddb-a933-854b62500b47 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.377s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-a1700447-fe33-4d3b-8c15-efe81dabea32 req-1b0e9f5d-f29e-46d4-b029-a044361c02b8 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received event network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1700447-fe33-4d3b-8c15-efe81dabea32 req-1b0e9f5d-f29e-46d4-b029-a044361c02b8 service nova] Acquiring lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1700447-fe33-4d3b-8c15-efe81dabea32 req-1b0e9f5d-f29e-46d4-b029-a044361c02b8 service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1700447-fe33-4d3b-8c15-efe81dabea32 req-1b0e9f5d-f29e-46d4-b029-a044361c02b8 service nova] Lock "dba4bc8c-6e06-4753-8d95-81d55520668d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-a1700447-fe33-4d3b-8c15-efe81dabea32 req-1b0e9f5d-f29e-46d4-b029-a044361c02b8 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] No waiting events found dispatching network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:20 user nova-compute[75097]: WARNING nova.compute.manager [req-a1700447-fe33-4d3b-8c15-efe81dabea32 req-1b0e9f5d-f29e-46d4-b029-a044361c02b8 service nova] [instance: dba4bc8c-6e06-4753-8d95-81d55520668d] Received unexpected event network-vif-plugged-075fe1bc-bc02-41e6-9ec7-0cb65a2a2510 for instance with vm_state deleted and task_state None.
Nov 14 16:04:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:26 user nova-compute[75097]: INFO nova.compute.manager [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Terminating instance
Nov 14 16:04:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-60feb43b-a654-4b01-9301-4c4c803071f6 req-b001f22d-ae82-473b-962b-1427b8db3cf1 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-unplugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-60feb43b-a654-4b01-9301-4c4c803071f6 req-b001f22d-ae82-473b-962b-1427b8db3cf1 service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-60feb43b-a654-4b01-9301-4c4c803071f6 req-b001f22d-ae82-473b-962b-1427b8db3cf1 service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-60feb43b-a654-4b01-9301-4c4c803071f6 req-b001f22d-ae82-473b-962b-1427b8db3cf1 service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-60feb43b-a654-4b01-9301-4c4c803071f6 req-b001f22d-ae82-473b-962b-1427b8db3cf1 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-unplugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-60feb43b-a654-4b01-9301-4c4c803071f6 req-b001f22d-ae82-473b-962b-1427b8db3cf1 service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-unplugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Instance destroyed successfully.
Nov 14 16:04:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lazy-loading 'resources' on Instance uuid d1b28242-ed4b-4ba8-8d18-d92ab06c46af {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:01:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-194969293',display_name='tempest-TestVolumeSwap-server-194969293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-194969293',id=9,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfCzQm/vUYp9cV78CUQ35nLWokwJrPq1SVVXhGCTssrxXui4+Zlh6Vjih5/v5aCoav1Y3ZHj8FftY/KsIuOuhi/PcojTHLfsqPlR6ZZHheeJ69rsBrNvr3hPK5Kdb50gA==',key_name='tempest-keypair-718775986',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d400c4a1bdd640b5991e15193e03b737',ramdisk_id='',reservation_id='r-kk0bwgqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1705499357',owner_user_name='tempest-TestVolumeSwap-1705499357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd3123fb41464b7c87ed6f4e98f4f15d',uuid=d1b28242-ed4b-4ba8-8d18-d92ab06c46af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Converting VIF {"id": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "address": "fa:16:3e:1e:15:9a", "network": {"id": "b727e216-9b4d-45a7-891f-724fc692ddc7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-573747766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d400c4a1bdd640b5991e15193e03b737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51daeaf9-89", "ovs_interfaceid": "51daeaf9-89d5-4bc7-8388-20e5bf938a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG os_vif [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51daeaf9-89, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8148364-0abf-4853-9440-b4762ff09acb) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: INFO os_vif [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:15:9a,bridge_name='br-int',has_traffic_filtering=True,id=51daeaf9-89d5-4bc7-8388-20e5bf938a55,network=Network(b727e216-9b4d-45a7-891f-724fc692ddc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51daeaf9-89')
Nov 14 16:04:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Deleting instance files /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af_del
Nov 14 16:04:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Deletion of /opt/stack/data/nova/instances/d1b28242-ed4b-4ba8-8d18-d92ab06c46af_del complete
Nov 14 16:04:27 user nova-compute[75097]: INFO nova.compute.manager [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 16:04:27 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:28 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Took 1.19 seconds to deallocate network for instance.
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-4f188181-f01f-492d-a61f-56844edec33c req-62123684-17bb-42b3-9bf2-d19409a1c75f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-deleted-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:28 user nova-compute[75097]: WARNING nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state deleted and task_state None.
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:28 user nova-compute[75097]: WARNING nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state deleted and task_state None.
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:28 user nova-compute[75097]: WARNING nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state deleted and task_state None.
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-unplugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-unplugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:28 user nova-compute[75097]: WARNING nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-unplugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state deleted and task_state None.
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Acquiring lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] No waiting events found dispatching network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:28 user nova-compute[75097]: WARNING nova.compute.manager [req-67e25ada-05cd-4edb-8ca2-d87a29e58e9b req-46217819-8e18-4038-ac79-466a29e7bb0f service nova] [instance: d1b28242-ed4b-4ba8-8d18-d92ab06c46af] Received unexpected event network-vif-plugged-51daeaf9-89d5-4bc7-8388-20e5bf938a55 for instance with vm_state deleted and task_state None.
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:04:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:28 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Deleted allocations for instance d1b28242-ed4b-4ba8-8d18-d92ab06c46af
Nov 14 16:04:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fc601d6d-82f4-412e-9125-8f2effb1ca09 tempest-TestVolumeSwap-1705499357 tempest-TestVolumeSwap-1705499357-project-member] Lock "d1b28242-ed4b-4ba8-8d18-d92ab06c46af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'flavor' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:04:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:31 user nova-compute[75097]: INFO nova.compute.manager [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Attaching volume 96c2fdb9-1a51-491b-9e80-42da8796edfc to /dev/vdb
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG os_brick.utils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a2821-c627-4086-b197-c11480ba6c79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc8e30a-3426-49d6-8215-1bbc1c83bef7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedb696a-f010-48ca-b2f5-4cae2ee73b84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94bd664-8276-44bb-b3e1-92fb992fc1ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:04:31 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6c649-63c7-43ad-895e-d16ec50cad26]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG os_brick.utils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating existing volume attachment record: 8b1b71b6-6e22-47c0-acfd-3838cb7f9cb8 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:04:31 user nova-compute[75097]: INFO nova.compute.claims [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Claim successful on node user
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:04:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:04:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:04:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Creating image(s)
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.policy [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e4dbd7176043dc87e7a41a87e60098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144c5ef426074ddca799c0f312162932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk 1073741824" returned: 0 in 0.059s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Cannot resize image /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Ensure instance console log exists: /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Successfully created port: 942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Successfully updated port: 942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquired lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-changed-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Refreshing instance network info cache due to event network-changed-942f59ad-3b4f-4545-ab74-de84dbf0e786. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] Acquiring lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updating instance_info_cache with network_info: [{"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Releasing lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance network_info: |[{"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] Acquired lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.neutron [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Refreshing network info cache for port 942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Start _get_guest_xml network_info=[{"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:04:35 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:04:35 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1600934682',display_name='tempest-tempest.common.compute-instance-1600934682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1600934682',id=17,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSXJJUSODFI4cAb2k9NEktgfAYWMb0LkasDxu0ebPJq3WK3O4/dIQAma25q1DmS8B+ZzHbyX8Dm37qKQvD1tndswkqegWiKxemgPlClz7T4zTEGctOcBZhCgUAj4Hjbg==',key_name='tempest-keypair-1661349674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-ulnvtc04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=f4eb61fa-ad89-4fad-b649-869efa6043c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.objects.instance [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'pci_devices' on Instance uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:04:35 user nova-compute[75097]:   <uuid>f4eb61fa-ad89-4fad-b649-869efa6043c0</uuid>
Nov 14 16:04:35 user nova-compute[75097]:   <name>instance-00000011</name>
Nov 14 16:04:35 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:04:35 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:04:35 user nova-compute[75097]:   <metadata>
Nov 14 16:04:35 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:04:35 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:04:35 user nova-compute[75097]:       <nova:name>tempest-tempest.common.compute-instance-1600934682</nova:name>
Nov 14 16:04:35 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:04:35</nova:creationTime>
Nov 14 16:04:35 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:04:35 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:04:35 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:04:35 user nova-compute[75097]:       <nova:owner>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:user uuid="e8e4dbd7176043dc87e7a41a87e60098">tempest-ServerActionsTestOtherA-715795194-project-member</nova:user>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:project uuid="144c5ef426074ddca799c0f312162932">tempest-ServerActionsTestOtherA-715795194</nova:project>
Nov 14 16:04:35 user nova-compute[75097]:       </nova:owner>
Nov 14 16:04:35 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:04:35 user nova-compute[75097]:       <nova:ports>
Nov 14 16:04:35 user nova-compute[75097]:         <nova:port uuid="942f59ad-3b4f-4545-ab74-de84dbf0e786">
Nov 14 16:04:35 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 16:04:35 user nova-compute[75097]:         </nova:port>
Nov 14 16:04:35 user nova-compute[75097]:       </nova:ports>
Nov 14 16:04:35 user nova-compute[75097]:     </nova:instance>
Nov 14 16:04:35 user nova-compute[75097]:   </metadata>
Nov 14 16:04:35 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:04:35 user nova-compute[75097]:     <system>
Nov 14 16:04:35 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:04:35 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:04:35 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:04:35 user nova-compute[75097]:       <entry name="serial">f4eb61fa-ad89-4fad-b649-869efa6043c0</entry>
Nov 14 16:04:35 user nova-compute[75097]:       <entry name="uuid">f4eb61fa-ad89-4fad-b649-869efa6043c0</entry>
Nov 14 16:04:35 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:04:35 user nova-compute[75097]:     </system>
Nov 14 16:04:35 user nova-compute[75097]:   </sysinfo>
Nov 14 16:04:35 user nova-compute[75097]:   <os>
Nov 14 16:04:35 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:04:35 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:04:35 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:04:35 user nova-compute[75097]:   </os>
Nov 14 16:04:35 user nova-compute[75097]:   <features>
Nov 14 16:04:35 user nova-compute[75097]:     <acpi/>
Nov 14 16:04:35 user nova-compute[75097]:     <apic/>
Nov 14 16:04:35 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:04:35 user nova-compute[75097]:   </features>
Nov 14 16:04:35 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:04:35 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:04:35 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:04:35 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:04:35 user nova-compute[75097]:   </clock>
Nov 14 16:04:35 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:04:35 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:04:35 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:04:35 user nova-compute[75097]:   </cpu>
Nov 14 16:04:35 user nova-compute[75097]:   <devices>
Nov 14 16:04:35 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:04:35 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:04:35 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk"/>
Nov 14 16:04:35 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:04:35 user nova-compute[75097]:     </disk>
Nov 14 16:04:35 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:04:35 user nova-compute[75097]:       <mac address="fa:16:3e:a8:3f:85"/>
Nov 14 16:04:35 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:04:35 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:04:35 user nova-compute[75097]:       <target dev="tap942f59ad-3b"/>
Nov 14 16:04:35 user nova-compute[75097]:     </interface>
Nov 14 16:04:35 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:04:35 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/console.log" append="off"/>
Nov 14 16:04:35 user nova-compute[75097]:     </serial>
Nov 14 16:04:35 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:04:35 user nova-compute[75097]:     <video>
Nov 14 16:04:35 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:04:35 user nova-compute[75097]:     </video>
Nov 14 16:04:35 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:04:35 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:04:35 user nova-compute[75097]:     </rng>
Nov 14 16:04:35 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:04:35 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:04:35 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:04:35 user nova-compute[75097]:     </memballoon>
Nov 14 16:04:35 user nova-compute[75097]:   </devices>
Nov 14 16:04:35 user nova-compute[75097]: </domain>
Nov 14 16:04:35 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1600934682',display_name='tempest-tempest.common.compute-instance-1600934682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1600934682',id=17,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSXJJUSODFI4cAb2k9NEktgfAYWMb0LkasDxu0ebPJq3WK3O4/dIQAma25q1DmS8B+ZzHbyX8Dm37qKQvD1tndswkqegWiKxemgPlClz7T4zTEGctOcBZhCgUAj4Hjbg==',key_name='tempest-keypair-1661349674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-ulnvtc04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=f4eb61fa-ad89-4fad-b649-869efa6043c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG os_vif [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34609748-5f36-56c4-96f5-eeb163b0ec56', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap942f59ad-3b, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap942f59ad-3b, col_values=(('qos', UUID('293e0253-bea3-47fe-9712-a5c824dbe47d')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap942f59ad-3b, col_values=(('external_ids', {'iface-id': '942f59ad-3b4f-4545-ab74-de84dbf0e786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:3f:85', 'vm-uuid': 'f4eb61fa-ad89-4fad-b649-869efa6043c0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:35 user nova-compute[75097]: INFO os_vif [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b')
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No VIF found with MAC fa:16:3e:a8:3f:85, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG nova.network.neutron [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updated VIF entry in instance network info cache for port 942f59ad-3b4f-4545-ab74-de84dbf0e786. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG nova.network.neutron [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updating instance_info_cache with network_info: [{"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-077d60c5-f86c-453a-930f-13623ed5bcb9 req-8283386d-27fe-40d6-a682-d14144fc341e service nova] Releasing lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-4f827caa-3b01-4648-941f-19d88504bf03 req-a97b1a7d-6927-4111-b3ae-fa1fd96e3bfd service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4f827caa-3b01-4648-941f-19d88504bf03 req-a97b1a7d-6927-4111-b3ae-fa1fd96e3bfd service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4f827caa-3b01-4648-941f-19d88504bf03 req-a97b1a7d-6927-4111-b3ae-fa1fd96e3bfd service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4f827caa-3b01-4648-941f-19d88504bf03 req-a97b1a7d-6927-4111-b3ae-fa1fd96e3bfd service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-4f827caa-3b01-4648-941f-19d88504bf03 req-a97b1a7d-6927-4111-b3ae-fa1fd96e3bfd service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:37 user nova-compute[75097]: WARNING nova.compute.manager [req-4f827caa-3b01-4648-941f-19d88504bf03 req-a97b1a7d-6927-4111-b3ae-fa1fd96e3bfd service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state building and task_state spawning.
Nov 14 16:04:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:04:37 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:04:37 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:04:37 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b98ee1-ef3f-4886-ab25-af109816408f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:04:37 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23666692-be7b-4ee8-ad94-b60ef900e855]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc] added
Nov 14 16:04:37 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[06917b5c-11e4-44cc-8c66-8dc0446fe214]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94e686e-78dc-4cdd-a6b8-c98e860f83ce]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDRdhbci {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDRdhbci" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef22477d-462f-405a-90ac-db018023af51]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tDRdhbci'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f46b91-f297-4293-b978-9bc7ec318785]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[77979434-f324-4bb8-849c-931641fa90d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:04:37 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:04:37 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:04:37 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:04:37 user nova-compute[75097]: 
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c62d53f-2787-458e-aba2-bd5ea02e62fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]
Nov 14 16:04:38 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.
Nov 14 16:04:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130a368-fb88-41ec-b938-4930944d7d06]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[925da99a-19fc-44ac-b7fa-a1d07adb0df8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:04:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:04:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[12832cb2-4cca-49e6-a563-786d7721efae]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:04:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.576s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== connect_volume: return (1578ms) {'type': 'block', 'scsi_wwn': '26637353130386134', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353130386134', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-c0f44956-1eb7-4974-ad89-b69d41c774aa req-b431704d-ca49-4f7a-8ddc-fe6d41bf244f service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c0f44956-1eb7-4974-ad89-b69d41c774aa req-b431704d-ca49-4f7a-8ddc-fe6d41bf244f service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c0f44956-1eb7-4974-ad89-b69d41c774aa req-b431704d-ca49-4f7a-8ddc-fe6d41bf244f service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c0f44956-1eb7-4974-ad89-b69d41c774aa req-b431704d-ca49-4f7a-8ddc-fe6d41bf244f service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-c0f44956-1eb7-4974-ad89-b69d41c774aa req-b431704d-ca49-4f7a-8ddc-fe6d41bf244f service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:39 user nova-compute[75097]: WARNING nova.compute.manager [req-c0f44956-1eb7-4974-ad89-b69d41c774aa req-b431704d-ca49-4f7a-8ddc-fe6d41bf244f service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state building and task_state spawning.
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:04:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:04:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=25.415821075439453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance spawned successfully.
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.objects.instance [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'flavor' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:04:39 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:04:39 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:04:39 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:04:39 user nova-compute[75097]:   <serial>96c2fdb9-1a51-491b-9e80-42da8796edfc</serial>
Nov 14 16:04:39 user nova-compute[75097]: </disk>
Nov 14 16:04:39 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 34098dea-702d-454d-af5e-35b51cac9bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f4eb61fa-ad89-4fad-b649-869efa6043c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:04:39 user nova-compute[75097]: INFO nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:04:39 user nova-compute[75097]: INFO nova.compute.manager [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Took 8.27 seconds to build instance.
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91df69ca-860a-42d5-8dc4-0e48b6b8d3d7 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.411s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No VIF found with MAC fa:16:3e:37:e9:7c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:04:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-50b67228-a85e-4535-b8ab-850e33d9dffc tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.986s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Stashing vm_state: active {{(pid=75097) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:04:42 user nova-compute[75097]: INFO nova.compute.claims [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Claim successful on node user
Nov 14 16:04:42 user nova-compute[75097]: INFO nova.compute.resource_tracker [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating resource usage from migration e8297787-41a8-4a18-aa0f-dc533a5f6179
Nov 14 16:04:43 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:04:43 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:04:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.531s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:43 user nova-compute[75097]: INFO nova.compute.manager [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Migrating
Nov 14 16:04:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:04:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:04:43 user nova-compute[75097]: INFO nova.compute.rpcapi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 16:04:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:04:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:04:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:04:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Starting migrate_disk_and_power_off {{(pid=75097) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-76f30a74-aa8e-413c-bf6f-a8e09088fe4f req-cbc7b7d1-3df1-4f65-bb21-f421132c460f service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-76f30a74-aa8e-413c-bf6f-a8e09088fe4f req-cbc7b7d1-3df1-4f65-bb21-f421132c460f service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-76f30a74-aa8e-413c-bf6f-a8e09088fe4f req-cbc7b7d1-3df1-4f65-bb21-f421132c460f service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-76f30a74-aa8e-413c-bf6f-a8e09088fe4f req-cbc7b7d1-3df1-4f65-bb21-f421132c460f service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-76f30a74-aa8e-413c-bf6f-a8e09088fe4f req-cbc7b7d1-3df1-4f65-bb21-f421132c460f service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:44 user nova-compute[75097]: WARNING nova.compute.manager [req-76f30a74-aa8e-413c-bf6f-a8e09088fe4f req-cbc7b7d1-3df1-4f65-bb21-f421132c460f service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state resize_migrating.
Nov 14 16:04:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance destroyed successfully.
Nov 14 16:04:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap665262a2-60, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78183248-feed-47a9-8252-fc20a1992b7c) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:45 user nova-compute[75097]: INFO os_vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60')
Nov 14 16:04:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:04:45 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0feac-811e-4e6b-89a2-98afd44dc1d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:04:45 user nova-compute[75097]: No targets found.
Nov 14 16:04:45 user nova-compute[75097]: iSNS:
Nov 14 16:04:45 user nova-compute[75097]: No targets found.
Nov 14 16:04:45 user nova-compute[75097]: STATIC:
Nov 14 16:04:45 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:04:45 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:04:45 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:04:45 user nova-compute[75097]: FIRMWARE:
Nov 14 16:04:45 user nova-compute[75097]: No targets found.
Nov 14 16:04:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:04:45 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:04:45 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e748ed3-99b9-4acb-ac6e-41704551ce31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[62877065-9d0e-448d-a910-2ab820a91da4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:04:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:04:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981ca0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ef2e1-50c4-44b8-9f0d-ad9b521e23c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b06b40-1380-4e2a-bd0a-a1230ac9aac8]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96cdee9-23c8-4d57-964c-e7e1b2d3b297]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313eae8-6fd6-4248-819d-c5d9ff850fe5]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02b8d9-6100-4236-b7cb-417b304ff121]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6244e-2764-4ef7-afd1-b0f40b886ce3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]
Nov 14 16:04:45 user nova-compute[75097]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.
Nov 14 16:04:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf53c07e-217c-4ddd-82ed-b806ded100d4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== disconnect_volume: return (313ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:04:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0_resize/disk /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "cp -r /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0_resize/disk /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk" returned: 0 in 0.516s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0_resize/disk.info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk.info {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "cp -r /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0_resize/disk.info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk.info" returned: 0 in 0.039s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-6d568393-78a9-4c2b-94c8-87e73fd034dc req-03dc705b-9b18-4ebd-ae5c-aa355c619e25 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6d568393-78a9-4c2b-94c8-87e73fd034dc req-03dc705b-9b18-4ebd-ae5c-aa355c619e25 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6d568393-78a9-4c2b-94c8-87e73fd034dc req-03dc705b-9b18-4ebd-ae5c-aa355c619e25 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6d568393-78a9-4c2b-94c8-87e73fd034dc req-03dc705b-9b18-4ebd-ae5c-aa355c619e25 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-6d568393-78a9-4c2b-94c8-87e73fd034dc req-03dc705b-9b18-4ebd-ae5c-aa355c619e25 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:46 user nova-compute[75097]: WARNING nova.compute.manager [req-6d568393-78a9-4c2b-94c8-87e73fd034dc req-03dc705b-9b18-4ebd-ae5c-aa355c619e25 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state resize_migrating.
Nov 14 16:04:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Port 665262a2-60e0-4453-aa2e-2e6373bc86cf binding to destination host user is already ACTIVE {{(pid=75097) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG os_brick.utils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed869a81-c26d-431e-b02c-68c9369e3145]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be62e113-c734-4d89-9f88-569d8ed91c59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[03616c0f-4e79-493a-848d-bec525466658]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51edae27-b75b-4faa-9766-555e4a5e5111]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:04:48 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:04:48 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db7793a-5314-4c79-a279-00fc6fa3384e]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:04:48 user nova-compute[75097]: DEBUG os_brick.utils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:04:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Starting finish_migration {{(pid=75097) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:04:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Creating image(s)
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk. size=21474836480 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk 21474836480 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk 21474836480" returned: 0 in 0.044s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Ensure instance console log exists: /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start _get_guest_xml network_info=[{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0eaff6ee-9806-4f4b-9492-ccc8328a63e0', 'attached_at': '2023-11-14T16:04:54.000000', 'detached_at': '', 'volume_id': '96c2fdb9-1a51-491b-9e80-42da8796edfc', 'serial': '96c2fdb9-1a51-491b-9e80-42da8796edfc'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '32287601-2a6a-4e02-b621-e4e04fe2e0a6', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:04:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:04:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:04:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:04:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:04:54 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[027db835-92df-4909-a005-76b3c6a2b2fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:04:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf019d-2310-47e0-b329-f4abcde96941]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc] added
Nov 14 16:04:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f5619-50e1-48c7-aea2-afd11d043bc7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2738a-579d-472f-8f59-d52406bdef2f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDRdhbci {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDRdhbci" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe3b46-bd61-4084-9298-ca616e381ba1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tDRdhbci'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7cb39d-f7e2-4c37-942a-f3797bc19f7d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bbbcb-983d-4cf8-be91-6a1ef964126c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:04:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:04:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:04:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:04:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:04:54 user nova-compute[75097]: 
Nov 14 16:04:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --login" returned: 0 in 1.052s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c4f926-7774-408c-a205-09166b02c688]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]
Nov 14 16:04:55 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.
Nov 14 16:04:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca149976-c7c8-4513-b7b1-89c4df665432]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:04:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c70f48f-5a92-48ef-9ef4-dd37949019e7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:04:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:04:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.268s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2a2eb-1542-428a-9741-214c9b590e1c]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:04:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.305s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== connect_volume: return (2308ms) {'type': 'block', 'scsi_wwn': '26637353130386134', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353130386134', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:04:57 user nova-compute[75097]:   <uuid>0eaff6ee-9806-4f4b-9492-ccc8328a63e0</uuid>
Nov 14 16:04:57 user nova-compute[75097]:   <name>instance-00000005</name>
Nov 14 16:04:57 user nova-compute[75097]:   <memory>2097152</memory>
Nov 14 16:04:57 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:04:57 user nova-compute[75097]:   <metadata>
Nov 14 16:04:57 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:04:57 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:04:57 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherB-server-462759233</nova:name>
Nov 14 16:04:57 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:04:54</nova:creationTime>
Nov 14 16:04:57 user nova-compute[75097]:       <nova:flavor name="m1.small">
Nov 14 16:04:57 user nova-compute[75097]:         <nova:memory>2048</nova:memory>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:disk>20</nova:disk>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:04:57 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:04:57 user nova-compute[75097]:       <nova:owner>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:user uuid="257dfabc0d374fdcaf4897d360547fb5">tempest-ServerActionsTestOtherB-652208077-project-member</nova:user>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:project uuid="0301ebf075c14cee925c28d1e74b1598">tempest-ServerActionsTestOtherB-652208077</nova:project>
Nov 14 16:04:57 user nova-compute[75097]:       </nova:owner>
Nov 14 16:04:57 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:04:57 user nova-compute[75097]:       <nova:ports>
Nov 14 16:04:57 user nova-compute[75097]:         <nova:port uuid="665262a2-60e0-4453-aa2e-2e6373bc86cf">
Nov 14 16:04:57 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:04:57 user nova-compute[75097]:         </nova:port>
Nov 14 16:04:57 user nova-compute[75097]:       </nova:ports>
Nov 14 16:04:57 user nova-compute[75097]:     </nova:instance>
Nov 14 16:04:57 user nova-compute[75097]:   </metadata>
Nov 14 16:04:57 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:04:57 user nova-compute[75097]:     <system>
Nov 14 16:04:57 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:04:57 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:04:57 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:04:57 user nova-compute[75097]:       <entry name="serial">0eaff6ee-9806-4f4b-9492-ccc8328a63e0</entry>
Nov 14 16:04:57 user nova-compute[75097]:       <entry name="uuid">0eaff6ee-9806-4f4b-9492-ccc8328a63e0</entry>
Nov 14 16:04:57 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:04:57 user nova-compute[75097]:     </system>
Nov 14 16:04:57 user nova-compute[75097]:   </sysinfo>
Nov 14 16:04:57 user nova-compute[75097]:   <os>
Nov 14 16:04:57 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:04:57 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:04:57 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:04:57 user nova-compute[75097]:   </os>
Nov 14 16:04:57 user nova-compute[75097]:   <features>
Nov 14 16:04:57 user nova-compute[75097]:     <acpi/>
Nov 14 16:04:57 user nova-compute[75097]:     <apic/>
Nov 14 16:04:57 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:04:57 user nova-compute[75097]:   </features>
Nov 14 16:04:57 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:04:57 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:04:57 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:04:57 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:04:57 user nova-compute[75097]:   </clock>
Nov 14 16:04:57 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:04:57 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:04:57 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:04:57 user nova-compute[75097]:   </cpu>
Nov 14 16:04:57 user nova-compute[75097]:   <devices>
Nov 14 16:04:57 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:04:57 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:04:57 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk"/>
Nov 14 16:04:57 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:04:57 user nova-compute[75097]:     </disk>
Nov 14 16:04:57 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:04:57 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:04:57 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:04:57 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:04:57 user nova-compute[75097]:       <serial>96c2fdb9-1a51-491b-9e80-42da8796edfc</serial>
Nov 14 16:04:57 user nova-compute[75097]:     </disk>
Nov 14 16:04:57 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:04:57 user nova-compute[75097]:       <mac address="fa:16:3e:37:e9:7c"/>
Nov 14 16:04:57 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:04:57 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:04:57 user nova-compute[75097]:       <target dev="tap665262a2-60"/>
Nov 14 16:04:57 user nova-compute[75097]:     </interface>
Nov 14 16:04:57 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:04:57 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/console.log" append="off"/>
Nov 14 16:04:57 user nova-compute[75097]:     </serial>
Nov 14 16:04:57 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:04:57 user nova-compute[75097]:     <video>
Nov 14 16:04:57 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:04:57 user nova-compute[75097]:     </video>
Nov 14 16:04:57 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:04:57 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:04:57 user nova-compute[75097]:     </rng>
Nov 14 16:04:57 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:04:57 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:04:57 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:04:57 user nova-compute[75097]:     </memballoon>
Nov 14 16:04:57 user nova-compute[75097]:   </devices>
Nov 14 16:04:57 user nova-compute[75097]: </domain>
Nov 14 16:04:57 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-979322385-network", "vif_mac": "fa:16:3e:37:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG os_vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2776eec1-7aab-5007-8038-4a01b095fe57', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap665262a2-60, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap665262a2-60, col_values=(('qos', UUID('3d62e56f-befb-477b-931c-0766c15d3ece')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap665262a2-60, col_values=(('external_ids', {'iface-id': '665262a2-60e0-4453-aa2e-2e6373bc86cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:e9:7c', 'vm-uuid': '0eaff6ee-9806-4f4b-9492-ccc8328a63e0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:57 user nova-compute[75097]: INFO os_vif [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60')
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:04:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] No VIF found with MAC fa:16:3e:37:e9:7c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-54bb7f8a-7f59-4f23-b400-9d98f052f753 req-95410fdb-6612-4a48-b1cf-139297660f79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-54bb7f8a-7f59-4f23-b400-9d98f052f753 req-95410fdb-6612-4a48-b1cf-139297660f79 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-54bb7f8a-7f59-4f23-b400-9d98f052f753 req-95410fdb-6612-4a48-b1cf-139297660f79 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-54bb7f8a-7f59-4f23-b400-9d98f052f753 req-95410fdb-6612-4a48-b1cf-139297660f79 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:04:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-54bb7f8a-7f59-4f23-b400-9d98f052f753 req-95410fdb-6612-4a48-b1cf-139297660f79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:04:58 user nova-compute[75097]: WARNING nova.compute.manager [req-54bb7f8a-7f59-4f23-b400-9d98f052f753 req-95410fdb-6612-4a48-b1cf-139297660f79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state resize_finish.
Nov 14 16:04:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:04:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:05:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance running successfully.
Nov 14 16:05:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Failed to set time: agent not configured {{(pid=75097) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f129ea2c-5674-43cf-84a5-96acc481a839 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] finish_migration finished successfully. {{(pid=75097) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4659186-407e-4cd0-ae6f-ee0fc6653c4b req-9a5ca248-2585-476a-9e56-396337d441c9 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4659186-407e-4cd0-ae6f-ee0fc6653c4b req-9a5ca248-2585-476a-9e56-396337d441c9 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4659186-407e-4cd0-ae6f-ee0fc6653c4b req-9a5ca248-2585-476a-9e56-396337d441c9 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4659186-407e-4cd0-ae6f-ee0fc6653c4b req-9a5ca248-2585-476a-9e56-396337d441c9 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4659186-407e-4cd0-ae6f-ee0fc6653c4b req-9a5ca248-2585-476a-9e56-396337d441c9 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:00 user nova-compute[75097]: WARNING nova.compute.manager [req-d4659186-407e-4cd0-ae6f-ee0fc6653c4b req-9a5ca248-2585-476a-9e56-396337d441c9 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state resize_finish.
Nov 14 16:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:22 user nova-compute[75097]: INFO nova.compute.manager [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Rescuing
Nov 14 16:05:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-41470d71-77c3-40e5-8867-5bca5770602a req-c899159b-6a17-4039-84bb-11fed5e9f9f4 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-41470d71-77c3-40e5-8867-5bca5770602a req-c899159b-6a17-4039-84bb-11fed5e9f9f4 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-41470d71-77c3-40e5-8867-5bca5770602a req-c899159b-6a17-4039-84bb-11fed5e9f9f4 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-41470d71-77c3-40e5-8867-5bca5770602a req-c899159b-6a17-4039-84bb-11fed5e9f9f4 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-41470d71-77c3-40e5-8867-5bca5770602a req-c899159b-6a17-4039-84bb-11fed5e9f9f4 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:23 user nova-compute[75097]: WARNING nova.compute.manager [req-41470d71-77c3-40e5-8867-5bca5770602a req-c899159b-6a17-4039-84bb-11fed5e9f9f4 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state rescuing.
Nov 14 16:05:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance destroyed successfully.
Nov 14 16:05:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Attempting rescue
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75097) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:05:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Creating image(s)
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'trusted_certs' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.223s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue" returned: 0 in 0.060s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'migration_context' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<b524df86-e1ec-4255-ba03-e8a314560af9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Start _get_guest_xml network_info=[{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:4b:53:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8453bef7-6457-4331-abaa-62588e201fe1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'resources' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<b524df86-e1ec-4255-ba03-e8a314560af9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'numa_topology' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<b524df86-e1ec-4255-ba03-e8a314560af9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:05:24 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:24 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'vcpu_model' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<b524df86-e1ec-4255-ba03-e8a314560af9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1146543409',display_name='tempest-ServerRescueNegativeTestJSON-server-1146543409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1146543409',id=3,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-ibox19u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:00:51Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=b524df86-e1ec-4255-ba03-e8a314560af9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:4b:53:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:4b:53:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'pci_devices' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<b524df86-e1ec-4255-ba03-e8a314560af9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:05:24 user nova-compute[75097]:   <uuid>b524df86-e1ec-4255-ba03-e8a314560af9</uuid>
Nov 14 16:05:24 user nova-compute[75097]:   <name>instance-00000003</name>
Nov 14 16:05:24 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:05:24 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:05:24 user nova-compute[75097]:   <metadata>
Nov 14 16:05:24 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:05:24 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:05:24 user nova-compute[75097]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1146543409</nova:name>
Nov 14 16:05:24 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:05:24</nova:creationTime>
Nov 14 16:05:24 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:05:24 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:05:24 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:05:24 user nova-compute[75097]:       <nova:owner>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:user uuid="a0d1946be4a442eb9b3bc8343510f656">tempest-ServerRescueNegativeTestJSON-2084860496-project-member</nova:user>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:project uuid="826e20e537274874bd3e0236eca9629f">tempest-ServerRescueNegativeTestJSON-2084860496</nova:project>
Nov 14 16:05:24 user nova-compute[75097]:       </nova:owner>
Nov 14 16:05:24 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:05:24 user nova-compute[75097]:       <nova:ports>
Nov 14 16:05:24 user nova-compute[75097]:         <nova:port uuid="bfb88ebb-9839-4650-a9c3-04f44b9f3310">
Nov 14 16:05:24 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:05:24 user nova-compute[75097]:         </nova:port>
Nov 14 16:05:24 user nova-compute[75097]:       </nova:ports>
Nov 14 16:05:24 user nova-compute[75097]:     </nova:instance>
Nov 14 16:05:24 user nova-compute[75097]:   </metadata>
Nov 14 16:05:24 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:05:24 user nova-compute[75097]:     <system>
Nov 14 16:05:24 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:05:24 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:05:24 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:05:24 user nova-compute[75097]:       <entry name="serial">b524df86-e1ec-4255-ba03-e8a314560af9</entry>
Nov 14 16:05:24 user nova-compute[75097]:       <entry name="uuid">b524df86-e1ec-4255-ba03-e8a314560af9</entry>
Nov 14 16:05:24 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:05:24 user nova-compute[75097]:     </system>
Nov 14 16:05:24 user nova-compute[75097]:   </sysinfo>
Nov 14 16:05:24 user nova-compute[75097]:   <os>
Nov 14 16:05:24 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:05:24 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:05:24 user nova-compute[75097]:   </os>
Nov 14 16:05:24 user nova-compute[75097]:   <features>
Nov 14 16:05:24 user nova-compute[75097]:     <acpi/>
Nov 14 16:05:24 user nova-compute[75097]:     <apic/>
Nov 14 16:05:24 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:05:24 user nova-compute[75097]:   </features>
Nov 14 16:05:24 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:05:24 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:05:24 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:05:24 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:05:24 user nova-compute[75097]:   </clock>
Nov 14 16:05:24 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:05:24 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:05:24 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:05:24 user nova-compute[75097]:   </cpu>
Nov 14 16:05:24 user nova-compute[75097]:   <devices>
Nov 14 16:05:24 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:05:24 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:05:24 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue"/>
Nov 14 16:05:24 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:05:24 user nova-compute[75097]:     </disk>
Nov 14 16:05:24 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:05:24 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:05:24 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk"/>
Nov 14 16:05:24 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:05:24 user nova-compute[75097]:     </disk>
Nov 14 16:05:24 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:05:24 user nova-compute[75097]:       <mac address="fa:16:3e:4b:53:26"/>
Nov 14 16:05:24 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:24 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:05:24 user nova-compute[75097]:       <target dev="tapbfb88ebb-98"/>
Nov 14 16:05:24 user nova-compute[75097]:     </interface>
Nov 14 16:05:24 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:05:24 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/console.log" append="off"/>
Nov 14 16:05:24 user nova-compute[75097]:     </serial>
Nov 14 16:05:24 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:05:24 user nova-compute[75097]:     <video>
Nov 14 16:05:24 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:24 user nova-compute[75097]:     </video>
Nov 14 16:05:24 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:05:24 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:05:24 user nova-compute[75097]:     </rng>
Nov 14 16:05:24 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:05:24 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:05:24 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:05:24 user nova-compute[75097]:     </memballoon>
Nov 14 16:05:24 user nova-compute[75097]:   </devices>
Nov 14 16:05:24 user nova-compute[75097]: </domain>
Nov 14 16:05:24 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:05:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance destroyed successfully.
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:4b:53:26, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:05:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-57a3d8d0-33d1-4138-b209-34dc7f610d1f req-e6d30386-6a6d-4da9-91da-6272b4ef58f6 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-57a3d8d0-33d1-4138-b209-34dc7f610d1f req-e6d30386-6a6d-4da9-91da-6272b4ef58f6 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-57a3d8d0-33d1-4138-b209-34dc7f610d1f req-e6d30386-6a6d-4da9-91da-6272b4ef58f6 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-57a3d8d0-33d1-4138-b209-34dc7f610d1f req-e6d30386-6a6d-4da9-91da-6272b4ef58f6 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-57a3d8d0-33d1-4138-b209-34dc7f610d1f req-e6d30386-6a6d-4da9-91da-6272b4ef58f6 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:26 user nova-compute[75097]: WARNING nova.compute.manager [req-57a3d8d0-33d1-4138-b209-34dc7f610d1f req-e6d30386-6a6d-4da9-91da-6272b4ef58f6 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state rescuing.
Nov 14 16:05:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:26 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:05:26 user nova-compute[75097]: INFO nova.compute.claims [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Claim successful on node user
Nov 14 16:05:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:05:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.policy [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac22930f0fb94bfbabe013f477e056ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73525a2ed1ed475994a7d12cf23aa81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:05:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Creating image(s)
Nov 14 16:05:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "/opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.228s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:28 user nova-compute[75097]: WARNING nova.compute.manager [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state rescuing.
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:28 user nova-compute[75097]: WARNING nova.compute.manager [req-6ddf782c-47ac-4251-b454-4c234a284ac5 req-e8bd40ae-f94e-44be-a945-e9a5872ae0fb service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state rescuing.
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.235s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk 1073741824" returned: 0 in 0.054s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Successfully created port: 19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.222s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Cannot resize image /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Ensure instance console log exists: /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0dfa3447-83b1-4124-9654-a4980caa1119 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Successfully updated port: 19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquired lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updating instance_info_cache with network_info: [{"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Releasing lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Instance network_info: |[{"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Start _get_guest_xml network_info=[{"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:05:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2139499498',display_name='tempest-AttachVolumeNegativeTest-server-2139499498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2139499498',id=18,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl62C/jygZkQlX9gJTgu0T4lpVlZU+l+cNwDuM91QnyO+xxCmP4fgxFInLBwMtLnQpoguFpmZNatcsF8WWeY3NcZbGblCEw5Mtn4X6WA/INBYrx9bjEmyYnNA07Mq0uXw==',key_name='tempest-keypair-106254152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-p3y5oakz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=343d4aa5-7639-48bd-be32-92cc8d0b57fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'pci_devices' on Instance uuid 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:05:29 user nova-compute[75097]:   <uuid>343d4aa5-7639-48bd-be32-92cc8d0b57fe</uuid>
Nov 14 16:05:29 user nova-compute[75097]:   <name>instance-00000012</name>
Nov 14 16:05:29 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:05:29 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:05:29 user nova-compute[75097]:   <metadata>
Nov 14 16:05:29 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:05:29 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:05:29 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2139499498</nova:name>
Nov 14 16:05:29 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:05:29</nova:creationTime>
Nov 14 16:05:29 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:05:29 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:05:29 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:05:29 user nova-compute[75097]:       <nova:owner>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:user uuid="ac22930f0fb94bfbabe013f477e056ca">tempest-AttachVolumeNegativeTest-907754384-project-member</nova:user>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:project uuid="73525a2ed1ed475994a7d12cf23aa81f">tempest-AttachVolumeNegativeTest-907754384</nova:project>
Nov 14 16:05:29 user nova-compute[75097]:       </nova:owner>
Nov 14 16:05:29 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:05:29 user nova-compute[75097]:       <nova:ports>
Nov 14 16:05:29 user nova-compute[75097]:         <nova:port uuid="19bce176-4dc2-41e0-960d-2a4bb314862f">
Nov 14 16:05:29 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:05:29 user nova-compute[75097]:         </nova:port>
Nov 14 16:05:29 user nova-compute[75097]:       </nova:ports>
Nov 14 16:05:29 user nova-compute[75097]:     </nova:instance>
Nov 14 16:05:29 user nova-compute[75097]:   </metadata>
Nov 14 16:05:29 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:05:29 user nova-compute[75097]:     <system>
Nov 14 16:05:29 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:05:29 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:05:29 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:05:29 user nova-compute[75097]:       <entry name="serial">343d4aa5-7639-48bd-be32-92cc8d0b57fe</entry>
Nov 14 16:05:29 user nova-compute[75097]:       <entry name="uuid">343d4aa5-7639-48bd-be32-92cc8d0b57fe</entry>
Nov 14 16:05:29 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:05:29 user nova-compute[75097]:     </system>
Nov 14 16:05:29 user nova-compute[75097]:   </sysinfo>
Nov 14 16:05:29 user nova-compute[75097]:   <os>
Nov 14 16:05:29 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:05:29 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:05:29 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:05:29 user nova-compute[75097]:   </os>
Nov 14 16:05:29 user nova-compute[75097]:   <features>
Nov 14 16:05:29 user nova-compute[75097]:     <acpi/>
Nov 14 16:05:29 user nova-compute[75097]:     <apic/>
Nov 14 16:05:29 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:05:29 user nova-compute[75097]:   </features>
Nov 14 16:05:29 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:05:29 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:05:29 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:05:29 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:05:29 user nova-compute[75097]:   </clock>
Nov 14 16:05:29 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:05:29 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:05:29 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:05:29 user nova-compute[75097]:   </cpu>
Nov 14 16:05:29 user nova-compute[75097]:   <devices>
Nov 14 16:05:29 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:05:29 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:05:29 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk"/>
Nov 14 16:05:29 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:05:29 user nova-compute[75097]:     </disk>
Nov 14 16:05:29 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:05:29 user nova-compute[75097]:       <mac address="fa:16:3e:a0:1e:06"/>
Nov 14 16:05:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:29 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:05:29 user nova-compute[75097]:       <target dev="tap19bce176-4d"/>
Nov 14 16:05:29 user nova-compute[75097]:     </interface>
Nov 14 16:05:29 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:05:29 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/console.log" append="off"/>
Nov 14 16:05:29 user nova-compute[75097]:     </serial>
Nov 14 16:05:29 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:05:29 user nova-compute[75097]:     <video>
Nov 14 16:05:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:29 user nova-compute[75097]:     </video>
Nov 14 16:05:29 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:05:29 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:05:29 user nova-compute[75097]:     </rng>
Nov 14 16:05:29 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:05:29 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:05:29 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:05:29 user nova-compute[75097]:     </memballoon>
Nov 14 16:05:29 user nova-compute[75097]:   </devices>
Nov 14 16:05:29 user nova-compute[75097]: </domain>
Nov 14 16:05:29 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2139499498',display_name='tempest-AttachVolumeNegativeTest-server-2139499498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2139499498',id=18,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl62C/jygZkQlX9gJTgu0T4lpVlZU+l+cNwDuM91QnyO+xxCmP4fgxFInLBwMtLnQpoguFpmZNatcsF8WWeY3NcZbGblCEw5Mtn4X6WA/INBYrx9bjEmyYnNA07Mq0uXw==',key_name='tempest-keypair-106254152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-p3y5oakz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=343d4aa5-7639-48bd-be32-92cc8d0b57fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG os_vif [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98b04df3-f04c-519b-9ecf-9a9490f166a6', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19bce176-4d, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19bce176-4d, col_values=(('qos', UUID('59ea1a0c-225a-43c1-9baf-6fb30da913ea')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19bce176-4d, col_values=(('external_ids', {'iface-id': '19bce176-4dc2-41e0-960d-2a4bb314862f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1e:06', 'vm-uuid': '343d4aa5-7639-48bd-be32-92cc8d0b57fe'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:29 user nova-compute[75097]: INFO os_vif [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d')
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:a0:1e:06, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-changed-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Refreshing instance network info cache due to event network-changed-19bce176-4dc2-41e0-960d-2a4bb314862f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] Acquiring lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] Acquired lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Refreshing network info cache for port 19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updated VIF entry in instance network info cache for port 19bce176-4dc2-41e0-960d-2a4bb314862f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updating instance_info_cache with network_info: [{"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc60f125-d61a-4f56-a171-966f6a7922d5 req-c115c8ef-7923-4488-b561-4f6ffd5790b0 service nova] Releasing lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c72b9b7-dea6-4059-8ac0-6c36ad67f7f1 req-877c440d-2911-47a9-afb5-7535c9c81f8a service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c72b9b7-dea6-4059-8ac0-6c36ad67f7f1 req-877c440d-2911-47a9-afb5-7535c9c81f8a service nova] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c72b9b7-dea6-4059-8ac0-6c36ad67f7f1 req-877c440d-2911-47a9-afb5-7535c9c81f8a service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c72b9b7-dea6-4059-8ac0-6c36ad67f7f1 req-877c440d-2911-47a9-afb5-7535c9c81f8a service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c72b9b7-dea6-4059-8ac0-6c36ad67f7f1 req-877c440d-2911-47a9-afb5-7535c9c81f8a service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] No waiting events found dispatching network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:32 user nova-compute[75097]: WARNING nova.compute.manager [req-6c72b9b7-dea6-4059-8ac0-6c36ad67f7f1 req-877c440d-2911-47a9-afb5-7535c9c81f8a service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received unexpected event network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f for instance with vm_state building and task_state spawning.
Nov 14 16:05:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:05:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Instance spawned successfully.
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:05:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:05:34 user nova-compute[75097]: INFO nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 14 16:05:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:34 user nova-compute[75097]: INFO nova.compute.manager [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Took 7.42 seconds to build instance.
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3a7e96f0-519d-4b36-adb3-480e06e17e58 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.609s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-337bea67-d0f4-4bca-b29a-b1e8e7c077b5 req-a582821c-1bc8-40f2-a0d8-2089b60a885c service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-337bea67-d0f4-4bca-b29a-b1e8e7c077b5 req-a582821c-1bc8-40f2-a0d8-2089b60a885c service nova] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-337bea67-d0f4-4bca-b29a-b1e8e7c077b5 req-a582821c-1bc8-40f2-a0d8-2089b60a885c service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-337bea67-d0f4-4bca-b29a-b1e8e7c077b5 req-a582821c-1bc8-40f2-a0d8-2089b60a885c service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-337bea67-d0f4-4bca-b29a-b1e8e7c077b5 req-a582821c-1bc8-40f2-a0d8-2089b60a885c service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] No waiting events found dispatching network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:34 user nova-compute[75097]: WARNING nova.compute.manager [req-337bea67-d0f4-4bca-b29a-b1e8e7c077b5 req-a582821c-1bc8-40f2-a0d8-2089b60a885c service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received unexpected event network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f for instance with vm_state active and task_state None.
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:40 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:40 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7512MB free_disk=25.322368621826172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Applying migration context for instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 as it has an incoming, in-progress migration e8297787-41a8-4a18-aa0f-dc533a5f6179. Migration status is finished {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 16:05:40 user nova-compute[75097]: INFO nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating resource usage from migration e8297787-41a8-4a18-aa0f-dc533a5f6179
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 34098dea-702d-454d-af5e-35b51cac9bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f4eb61fa-ad89-4fad-b649-869efa6043c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Migration e8297787-41a8-4a18-aa0f-dc533a5f6179 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 17946bc0-ba29-42a0-8993-74699b98d836 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:05:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.606s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:05:41 user nova-compute[75097]: INFO nova.compute.claims [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Claim successful on node user
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-changed-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Refreshing instance network info cache due to event network-changed-0297ecfb-7446-4658-8ff2-de675bb1d52d. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] Acquiring lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] Acquired lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Refreshing network info cache for port 0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:05:42 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.policy [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb8d8995adaf45e985b4b89db7aa0f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d8fef64a574c1a8f84050f13037e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:05:42 user nova-compute[75097]: INFO nova.virt.block_device [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Booting with volume 72d47ead-46be-4262-a78a-e2ed8c151a70 at /dev/vda
Nov 14 16:05:42 user nova-compute[75097]: DEBUG os_brick.utils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f8212-0abf-4625-b9d5-69a98932bfe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9a5d6a-5842-4bb7-aed0-94d8c1403ebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3d99b3-1442-4d63-a365-8ec127335016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[036347d7-e652-4a9b-acc4-0fada5c28cfa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:05:42 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[35869223-f450-49b2-898f-643790d14361]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG os_brick.utils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating existing volume attachment record: 1aaae172-136e-42c7-81c1-f4bbdbee619c {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "interface-9f739f81-f9a3-4b90-a99d-12bd82c3602d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "interface-9f739f81-f9a3-4b90-a99d-12bd82c3602d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'flavor' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updated VIF entry in instance network info cache for port 0297ecfb-7446-4658-8ff2-de675bb1d52d. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-07e374e2-a8a9-436e-b192-e3e47b48892d req-70ceea3a-8529-4773-be4a-606b764d375b service nova] Releasing lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.objects.base [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Object Instance<9f739f81-f9a3-4b90-a99d-12bd82c3602d> lazy-loaded attributes: flavor,pci_requests {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:05:42 user nova-compute[75097]: DEBUG nova.policy [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5f35d919f944a3984a538daa57fef3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7b3f9a7c5942a395e55f73157a7dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Successfully created port: dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:05:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Successfully created port: feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Successfully updated port: dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing instance network info cache due to event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance network_info: |[{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Successfully updated port: feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquired lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-changed-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Refreshing instance network info cache due to event network-changed-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:05:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] Acquiring lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updated VIF entry in instance network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b66888ff-422d-4aaf-b6d0-0197db5a42d1 req-986c9798-88c7-4ec4-8d2b-27a0b89494dd service nova] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Releasing lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] Acquired lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Refreshing network info cache for port feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG os_vif [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f5af2ec-8d45-567c-b86e-c74c7cd9e9cb', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeb3ae8b-aa, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfeb3ae8b-aa, col_values=(('qos', UUID('ba09b920-a302-4e1f-a8c7-bbe366eb7b8d')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfeb3ae8b-aa, col_values=(('external_ids', {'iface-id': 'feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a9:d6', 'vm-uuid': '9f739f81-f9a3-4b90-a99d-12bd82c3602d'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: INFO os_vif [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa')
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] attach device xml: <interface type="ethernet">
Nov 14 16:05:45 user nova-compute[75097]:   <mac address="fa:16:3e:f5:a9:d6"/>
Nov 14 16:05:45 user nova-compute[75097]:   <model type="virtio"/>
Nov 14 16:05:45 user nova-compute[75097]:   <mtu size="1442"/>
Nov 14 16:05:45 user nova-compute[75097]:   <target dev="tapfeb3ae8b-aa"/>
Nov 14 16:05:45 user nova-compute[75097]: </interface>
Nov 14 16:05:45 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.network.neutron [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updated VIF entry in instance network info cache for port feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.network.neutron [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2fb03a99-3374-4eb5-a195-e55eaf368d86 req-7fc518a0-8b32-4384-8b02-c8102e0f16b7 service nova] Releasing lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No BDM found with device name hda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No VIF found with MAC fa:16:3e:6b:82:67, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:05:46 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:05:46 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:05:46 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:05:46</nova:creationTime>
Nov 14 16:05:46 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:05:46 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:05:46 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:05:46 user nova-compute[75097]:   <nova:owner>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:05:46 user nova-compute[75097]:   </nova:owner>
Nov 14 16:05:46 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:05:46 user nova-compute[75097]:   <nova:ports>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:05:46 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:05:46 user nova-compute[75097]:     </nova:port>
Nov 14 16:05:46 user nova-compute[75097]:     <nova:port uuid="feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7">
Nov 14 16:05:46 user nova-compute[75097]:       <nova:ip type="fixed" address="10.10.10.20" ipVersion="4"/>
Nov 14 16:05:46 user nova-compute[75097]:     </nova:port>
Nov 14 16:05:46 user nova-compute[75097]:   </nova:ports>
Nov 14 16:05:46 user nova-compute[75097]: </nova:instance>
Nov 14 16:05:46 user nova-compute[75097]:  {{(pid=75097) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0cda25d8-9280-4d7c-90cf-4b613e2a2acb tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "interface-9f739f81-f9a3-4b90-a99d-12bd82c3602d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.612s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'flavor' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:46 user nova-compute[75097]: INFO nova.compute.manager [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Attaching volume 7fc8890f-a7f6-4aef-9257-3adfcc3f1911 to /dev/vdb
Nov 14 16:05:46 user nova-compute[75097]: DEBUG os_brick.utils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72670bf-3605-4c13-b4a2-c8e4e5f4b81d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd02c34e-c023-46f0-9457-51a1e1856aa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f097d36-bb91-4260-9fa2-213d60c428af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65dfeee-317b-475d-9ba1-9a579077ff1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:05:47 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:05:47 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f162c4-c65e-457b-bdea-4da2d240c28d]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG os_brick.utils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:05:47 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating existing volume attachment record: a6132753-9053-43da-b832-9a9ec5a087dc {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:05:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-fedb53f4-bc25-4668-8ad8-7240a064aada req-d04447be-8cca-43ae-8d8b-30813dc771a1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fedb53f4-bc25-4668-8ad8-7240a064aada req-d04447be-8cca-43ae-8d8b-30813dc771a1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fedb53f4-bc25-4668-8ad8-7240a064aada req-d04447be-8cca-43ae-8d8b-30813dc771a1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fedb53f4-bc25-4668-8ad8-7240a064aada req-d04447be-8cca-43ae-8d8b-30813dc771a1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-fedb53f4-bc25-4668-8ad8-7240a064aada req-d04447be-8cca-43ae-8d8b-30813dc771a1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:48 user nova-compute[75097]: WARNING nova.compute.manager [req-fedb53f4-bc25-4668-8ad8-7240a064aada req-d04447be-8cca-43ae-8d8b-30813dc771a1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 for instance with vm_state active and task_state None.
Nov 14 16:05:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:05:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:49 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:05:49 user nova-compute[75097]: INFO nova.compute.claims [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Claim successful on node user
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:50 user nova-compute[75097]: INFO nova.compute.manager [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Terminating instance
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:05:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc9f98e2-71b3-4d87-b6f0-e781d9b73530 req-c9b6b96d-4ba7-4c81-9bfe-27f9429ff2f1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc9f98e2-71b3-4d87-b6f0-e781d9b73530 req-c9b6b96d-4ba7-4c81-9bfe-27f9429ff2f1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc9f98e2-71b3-4d87-b6f0-e781d9b73530 req-c9b6b96d-4ba7-4c81-9bfe-27f9429ff2f1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc9f98e2-71b3-4d87-b6f0-e781d9b73530 req-c9b6b96d-4ba7-4c81-9bfe-27f9429ff2f1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc9f98e2-71b3-4d87-b6f0-e781d9b73530 req-c9b6b96d-4ba7-4c81-9bfe-27f9429ff2f1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:50 user nova-compute[75097]: WARNING nova.compute.manager [req-bc9f98e2-71b3-4d87-b6f0-e781d9b73530 req-c9b6b96d-4ba7-4c81-9bfe-27f9429ff2f1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 for instance with vm_state active and task_state None.
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:05:50 user nova-compute[75097]: INFO nova.virt.block_device [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Booting with volume ce70618b-8eed-4afe-9d95-08498ea3e605 at /dev/vda
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.policy [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd73d9a3d5f3487b8fdccf2a46c3736d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb9642780d214f218f29ba0ecc8204f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-71c3c466-6a7e-4762-88c7-a910a433e0ac req-85dd9ba8-e8a6-4c45-86e9-1c8b03239ecb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-vif-unplugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-71c3c466-6a7e-4762-88c7-a910a433e0ac req-85dd9ba8-e8a6-4c45-86e9-1c8b03239ecb service nova] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-71c3c466-6a7e-4762-88c7-a910a433e0ac req-85dd9ba8-e8a6-4c45-86e9-1c8b03239ecb service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-71c3c466-6a7e-4762-88c7-a910a433e0ac req-85dd9ba8-e8a6-4c45-86e9-1c8b03239ecb service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-71c3c466-6a7e-4762-88c7-a910a433e0ac req-85dd9ba8-e8a6-4c45-86e9-1c8b03239ecb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] No waiting events found dispatching network-vif-unplugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-71c3c466-6a7e-4762-88c7-a910a433e0ac req-85dd9ba8-e8a6-4c45-86e9-1c8b03239ecb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-vif-unplugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG os_brick.utils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3df3ee-0a59-4794-adcc-96bca398aa7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29409a-f717-4415-b9ed-b3954af6705e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f19c46-be35-4a18-b204-c561a26fd818]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da8cae-6ff5-4b13-ac23-a9e52bd36567]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:05:51 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b11819-91df-44bc-a19f-d9576a415674]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG os_brick.utils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updating existing volume attachment record: abc54adb-673e-41fe-99af-7c590280b0dc {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:05:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Instance destroyed successfully.
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'resources' on Instance uuid d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1359421202',display_name='tempest-VolumesAdminNegativeTest-server-1359421202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1359421202',id=16,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1f76214f6904b62b3b8987610bc22c5',ramdisk_id='',reservation_id='r-zzjic7ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1445801438',owner_user_name='tempest-VolumesAdminNegativeTest-1445801438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:04:00Z,user_data=None,user_id='403e6a373c874a42b09067107b75355e',uuid=d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converting VIF {"id": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "address": "fa:16:3e:8a:03:3a", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17bc8bee-dd", "ovs_interfaceid": "17bc8bee-dd61-40f2-b033-8c7e550a6acf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG os_vif [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17bc8bee-dd, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88b81ce0-df97-44ff-b21c-88e074165819) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:51 user nova-compute[75097]: INFO os_vif [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:03:3a,bridge_name='br-int',has_traffic_filtering=True,id=17bc8bee-dd61-40f2-b033-8c7e550a6acf,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17bc8bee-dd')
Nov 14 16:05:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Deleting instance files /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8_del
Nov 14 16:05:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Deletion of /opt/stack/data/nova/instances/d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8_del complete
Nov 14 16:05:51 user nova-compute[75097]: INFO nova.compute.manager [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Successfully created port: 43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:51 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Took 0.55 seconds to deallocate network for instance.
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.592s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Successfully updated port: 43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquired lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:05:52 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Deleted allocations for instance d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e2e2cc5e-5bbc-46b0-9197-4c6081e86770 tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-changed-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Refreshing instance network info cache due to event network-changed-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] Acquiring lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updating instance_info_cache with network_info: [{"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Releasing lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance network_info: |[{"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] Acquired lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Refreshing network info cache for port 43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] Acquiring lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] Lock "d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] No waiting events found dispatching network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:52 user nova-compute[75097]: WARNING nova.compute.manager [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received unexpected event network-vif-plugged-17bc8bee-dd61-40f2-b033-8c7e550a6acf for instance with vm_state deleted and task_state None.
Nov 14 16:05:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-d18e46c1-3079-4a4d-9d37-efdc2ea6e8ee req-3b52c9f3-f3a3-4b9f-9500-50ef51dce4fb service nova] [instance: d5e1bfb1-dc91-4fc4-8803-c931d12b6ed8] Received event network-vif-deleted-17bc8bee-dd61-40f2-b033-8c7e550a6acf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updated VIF entry in instance network info cache for port 43a2ed50-c777-4f1a-ae7f-f9b820c33fb5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:05:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updating instance_info_cache with network_info: [{"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:05:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c9d0f56d-f646-40f4-ae12-72178a3f1953 req-462fd3fe-bc5b-487e-b41e-9fa2da4699fe service nova] Releasing lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhUamVwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:05:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:05:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:05:54 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44b0a70-13ec-44ab-8614-a0ce63c0bb3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:05:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfacd92-6e51-49b2-8906-dd7bd7680126]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911] added
Nov 14 16:05:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4de05e-bbec-4117-9caa-4063de884775]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aed185-3402-4ec6-9862-6b02597a16b3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhUamVwW {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhUamVwW" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d627921a-97d1-4c78-a438-1cdd50f7b007]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhUamVwW'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49f5c0-66b9-40e6-8804-d7b17f4405a0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d709561-35e0-487d-8ad4-d4d4f2917d50]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:05:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Creating image(s)
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Ensure instance console log exists: /opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Start _get_guest_xml network_info=[{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17946bc0-ba29-42a0-8993-74699b98d836', 'attached_at': '', 'detached_at': '', 'volume_id': '72d47ead-46be-4262-a78a-e2ed8c151a70', 'serial': '72d47ead-46be-4262-a78a-e2ed8c151a70'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '1aaae172-136e-42c7-81c1-f4bbdbee619c', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:05:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6192ee6-0fd1-4f5e-b3ea-9269cd394d53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260]
Nov 14 16:05:54 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260] successful.
Nov 14 16:05:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:05:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e76527b-6903-4fcb-a8bf-f02020453232]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3a9d61-95c6-4903-b3a6-2b6616e7aec0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:54 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:54 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d5b34-576a-48c0-b1e0-a9947d0f13ac]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhUamVwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26666323137363561', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666323137363561', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.064s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:05:55 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:05:55 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:05:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'flavor' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e37529-11c9-4956-b89a-75485a3932c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:05:55 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:05:55 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:05:55 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:05:55 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:05:55 user nova-compute[75097]:   <serial>7fc8890f-a7f6-4aef-9257-3adfcc3f1911</serial>
Nov 14 16:05:55 user nova-compute[75097]: </disk>
Nov 14 16:05:55 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[00853e4e-42cf-4143-ab61-5d3f48972329]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70] added
Nov 14 16:05:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338dc66-76d3-4462-897e-d3bb0c585f27]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.111s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a366ea77-6dd0-4a4d-b44e-4122ef780caa]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiJOcdDA {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiJOcdDA" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67bb8c7-16df-4f1d-811f-f07699ece0c6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PiJOcdDA'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ebfa33-74fe-4453-a1a8-9e9b5161f8d3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfdd2d0-65dc-4a5b-b1ad-b1a113934eed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:56 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:56 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:05:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Creating image(s)
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Ensure instance console log exists: /opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Start _get_guest_xml network_info=[{"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c34dc8a1-71ab-491d-a915-6f8e1f4f1d31', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce70618b-8eed-4afe-9d95-08498ea3e605', 'serial': 'ce70618b-8eed-4afe-9d95-08498ea3e605'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'abc54adb-673e-41fe-99af-7c590280b0dc', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:05:56 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:56 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:05:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7714375-047f-49e8-bea2-1f0c68b028d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]
Nov 14 16:05:56 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.
Nov 14 16:05:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb81f717-f1c3-4eaa-89b0-74181d7ae330]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4941f3-9d22-439f-817e-1e09c5a34080]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:56 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:56 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:05:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:56 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:56 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:05:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a2c7fc-7346-4b10-aa78-2c25a91b8107]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No BDM found with device name hda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] No VIF found with MAC fa:16:3e:6b:82:67, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:05:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c5f90b92-ecfb-4a0a-a51d-8b6d1ef8b8a7 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.790s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] <== connect_volume: return (2498ms) {'type': 'block', 'scsi_wwn': '26637303636363832', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637303636363832', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.087s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:05:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:05:57 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ffc67c-97e5-453f-8dca-7a5d5a978226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:05:57 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-919452920',display_name='tempest-TestShelveInstance-server-919452920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-919452920',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiY2HrfDj1C2gaBtxDT6WTs6MBko57MU0MO1DoFNrMJWy9jcDKy1reHO2T4cqs0aCY1D81Sz3UfemSj0ny7Sa7kXg17a1ROT+RVHOcbF2FqDNXX6sMOfTf0sAaJ1io50Q==',key_name='tempest-TestShelveInstance-372931991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d8fef64a574c1a8f84050f13037e65',ramdisk_id='',reservation_id='r-fb53j1rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2055532680',owner_user_name='tempest-TestShelveInstance-2055532680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:05:42Z,user_data=None,user_id='fb8d8995adaf45e985b4b89db7aa0f1d',uuid=17946bc0-ba29-42a0-8993-74699b98d836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converting VIF {"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.objects.instance [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'pci_devices' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:05:57 user nova-compute[75097]:   <uuid>17946bc0-ba29-42a0-8993-74699b98d836</uuid>
Nov 14 16:05:57 user nova-compute[75097]:   <name>instance-00000013</name>
Nov 14 16:05:57 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:05:57 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:05:57 user nova-compute[75097]:   <metadata>
Nov 14 16:05:57 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:05:57 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:05:57 user nova-compute[75097]:       <nova:name>tempest-TestShelveInstance-server-919452920</nova:name>
Nov 14 16:05:57 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:05:54</nova:creationTime>
Nov 14 16:05:57 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:05:57 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:05:57 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:05:57 user nova-compute[75097]:       <nova:owner>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:user uuid="fb8d8995adaf45e985b4b89db7aa0f1d">tempest-TestShelveInstance-2055532680-project-member</nova:user>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:project uuid="e6d8fef64a574c1a8f84050f13037e65">tempest-TestShelveInstance-2055532680</nova:project>
Nov 14 16:05:57 user nova-compute[75097]:       </nova:owner>
Nov 14 16:05:57 user nova-compute[75097]:       <nova:ports>
Nov 14 16:05:57 user nova-compute[75097]:         <nova:port uuid="dbabe2fe-db2b-40eb-96d5-1d064d9c48c5">
Nov 14 16:05:57 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:05:57 user nova-compute[75097]:         </nova:port>
Nov 14 16:05:57 user nova-compute[75097]:       </nova:ports>
Nov 14 16:05:57 user nova-compute[75097]:     </nova:instance>
Nov 14 16:05:57 user nova-compute[75097]:   </metadata>
Nov 14 16:05:57 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:05:57 user nova-compute[75097]:     <system>
Nov 14 16:05:57 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:05:57 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:05:57 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:05:57 user nova-compute[75097]:       <entry name="serial">17946bc0-ba29-42a0-8993-74699b98d836</entry>
Nov 14 16:05:57 user nova-compute[75097]:       <entry name="uuid">17946bc0-ba29-42a0-8993-74699b98d836</entry>
Nov 14 16:05:57 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:05:57 user nova-compute[75097]:     </system>
Nov 14 16:05:57 user nova-compute[75097]:   </sysinfo>
Nov 14 16:05:57 user nova-compute[75097]:   <os>
Nov 14 16:05:57 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:05:57 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:05:57 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:05:57 user nova-compute[75097]:   </os>
Nov 14 16:05:57 user nova-compute[75097]:   <features>
Nov 14 16:05:57 user nova-compute[75097]:     <acpi/>
Nov 14 16:05:57 user nova-compute[75097]:     <apic/>
Nov 14 16:05:57 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:05:57 user nova-compute[75097]:   </features>
Nov 14 16:05:57 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:05:57 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:05:57 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:05:57 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:05:57 user nova-compute[75097]:   </clock>
Nov 14 16:05:57 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:05:57 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:05:57 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:05:57 user nova-compute[75097]:   </cpu>
Nov 14 16:05:57 user nova-compute[75097]:   <devices>
Nov 14 16:05:57 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:05:57 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:05:57 user nova-compute[75097]:       <source dev="/dev/sdd"/>
Nov 14 16:05:57 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:05:57 user nova-compute[75097]:       <serial>72d47ead-46be-4262-a78a-e2ed8c151a70</serial>
Nov 14 16:05:57 user nova-compute[75097]:     </disk>
Nov 14 16:05:57 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:05:57 user nova-compute[75097]:       <mac address="fa:16:3e:63:8c:2e"/>
Nov 14 16:05:57 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:57 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:05:57 user nova-compute[75097]:       <target dev="tapdbabe2fe-db"/>
Nov 14 16:05:57 user nova-compute[75097]:     </interface>
Nov 14 16:05:57 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:05:57 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836/console.log" append="off"/>
Nov 14 16:05:57 user nova-compute[75097]:     </serial>
Nov 14 16:05:57 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:05:57 user nova-compute[75097]:     <video>
Nov 14 16:05:57 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:57 user nova-compute[75097]:     </video>
Nov 14 16:05:57 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:05:57 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:05:57 user nova-compute[75097]:     </rng>
Nov 14 16:05:57 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:05:57 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:05:57 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:05:57 user nova-compute[75097]:     </memballoon>
Nov 14 16:05:57 user nova-compute[75097]:   </devices>
Nov 14 16:05:57 user nova-compute[75097]: </domain>
Nov 14 16:05:57 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-919452920',display_name='tempest-TestShelveInstance-server-919452920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-919452920',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiY2HrfDj1C2gaBtxDT6WTs6MBko57MU0MO1DoFNrMJWy9jcDKy1reHO2T4cqs0aCY1D81Sz3UfemSj0ny7Sa7kXg17a1ROT+RVHOcbF2FqDNXX6sMOfTf0sAaJ1io50Q==',key_name='tempest-TestShelveInstance-372931991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d8fef64a574c1a8f84050f13037e65',ramdisk_id='',reservation_id='r-fb53j1rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2055532680',owner_user_name='tempest-TestShelveInstance-2055532680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:05:42Z,user_data=None,user_id='fb8d8995adaf45e985b4b89db7aa0f1d',uuid=17946bc0-ba29-42a0-8993-74699b98d836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converting VIF {"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_vif [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a071268b-74d6-52ec-a649-2e7e46f3cb4a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a2f3d-5044-4a63-ba28-2fc268f8d7e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605] added
Nov 14 16:05:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbabe2fe-db, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbabe2fe-db, col_values=(('qos', UUID('8cc872d3-b715-4695-9ec9-7e24ccc84ef7')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbabe2fe-db, col_values=(('external_ids', {'iface-id': 'dbabe2fe-db2b-40eb-96d5-1d064d9c48c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:8c:2e', 'vm-uuid': '17946bc0-ba29-42a0-8993-74699b98d836'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01c037-88fd-48b0-95cd-221a7dcea2b2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:57 user nova-compute[75097]: INFO os_vif [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db')
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0745d-3ddd-450d-8b40-6b5b488a1bd4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmGUJsAE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmGUJsAE" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d932320d-841a-4ff1-9ee8-032c334e9a0d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmGUJsAE'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] No VIF found with MAC fa:16:3e:63:8c:2e, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea642c6e-c866-45a5-8fe0-6103a1f756dc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc09f2-ed92-4fdc-b52b-64ba5bd5d0b2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd304c0-ad2d-442b-8a61-8561d8c732a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]
Nov 14 16:05:57 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.
Nov 14 16:05:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e399e356-f297-4c62-910c-75ad1631507f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e844896-e1d2-471e-ac53-2254b3eed2af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:05:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:05:57 user nova-compute[75097]: INFO nova.compute.manager [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Detaching volume 7fc8890f-a7f6-4aef-9257-3adfcc3f1911
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[58545f0e-f150-4811-8a90-6596d8dce15f]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:05:57 user nova-compute[75097]: INFO nova.virt.block_device [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Attempting to driver detach volume 7fc8890f-a7f6-4aef-9257-3adfcc3f1911 from mountpoint /dev/vdb
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Attempting to detach device vdb from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:05:57 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:05:57 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:05:57 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:05:57 user nova-compute[75097]:   <serial>7fc8890f-a7f6-4aef-9257-3adfcc3f1911</serial>
Nov 14 16:05:57 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 16:05:57 user nova-compute[75097]: </disk>
Nov 14 16:05:57 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:05:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully detached device vdb from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the persistent domain config.
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:05:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:05:57 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:05:57 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:05:57 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:05:57 user nova-compute[75097]:   <serial>7fc8890f-a7f6-4aef-9257-3adfcc3f1911</serial>
Nov 14 16:05:57 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 16:05:57 user nova-compute[75097]: </disk>
Nov 14 16:05:57 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== connect_volume: return (2439ms) {'type': 'block', 'scsi_wwn': '23030653635393734', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653635393734', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1193502518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1193502518',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkIvTZHy4KCWvjGUuzJP72IVTPtf+u/1pwxKhzdWAgjAFhtu7cSu8Q5VgjjvuqBIuu0k8oCSQG24jxFaMwkUeI6BwpC/rxUeyNW5Q1nvMARgKI51zUDpJhGjgzc0MkrhQ==',key_name='tempest-keypair-2065858370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb9642780d214f218f29ba0ecc8204f3',ramdisk_id='',reservation_id='r-yc0iaadf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1509095738',owner_user_name='tempest-ServerActionsV293TestJSON-1509095738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd73d9a3d5f3487b8fdccf2a46c3736d',uuid=c34dc8a1-71ab-491d-a915-6f8e1f4f1d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converting VIF {"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lazy-loading 'pci_devices' on Instance uuid c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:05:58 user nova-compute[75097]:   <uuid>c34dc8a1-71ab-491d-a915-6f8e1f4f1d31</uuid>
Nov 14 16:05:58 user nova-compute[75097]:   <name>instance-00000014</name>
Nov 14 16:05:58 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:05:58 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:05:58 user nova-compute[75097]:   <metadata>
Nov 14 16:05:58 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:05:58 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:05:58 user nova-compute[75097]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1193502518</nova:name>
Nov 14 16:05:58 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:05:56</nova:creationTime>
Nov 14 16:05:58 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:05:58 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:05:58 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:05:58 user nova-compute[75097]:       <nova:owner>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:user uuid="cd73d9a3d5f3487b8fdccf2a46c3736d">tempest-ServerActionsV293TestJSON-1509095738-project-member</nova:user>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:project uuid="fb9642780d214f218f29ba0ecc8204f3">tempest-ServerActionsV293TestJSON-1509095738</nova:project>
Nov 14 16:05:58 user nova-compute[75097]:       </nova:owner>
Nov 14 16:05:58 user nova-compute[75097]:       <nova:ports>
Nov 14 16:05:58 user nova-compute[75097]:         <nova:port uuid="43a2ed50-c777-4f1a-ae7f-f9b820c33fb5">
Nov 14 16:05:58 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 16:05:58 user nova-compute[75097]:         </nova:port>
Nov 14 16:05:58 user nova-compute[75097]:       </nova:ports>
Nov 14 16:05:58 user nova-compute[75097]:     </nova:instance>
Nov 14 16:05:58 user nova-compute[75097]:   </metadata>
Nov 14 16:05:58 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:05:58 user nova-compute[75097]:     <system>
Nov 14 16:05:58 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:05:58 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:05:58 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:05:58 user nova-compute[75097]:       <entry name="serial">c34dc8a1-71ab-491d-a915-6f8e1f4f1d31</entry>
Nov 14 16:05:58 user nova-compute[75097]:       <entry name="uuid">c34dc8a1-71ab-491d-a915-6f8e1f4f1d31</entry>
Nov 14 16:05:58 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:05:58 user nova-compute[75097]:     </system>
Nov 14 16:05:58 user nova-compute[75097]:   </sysinfo>
Nov 14 16:05:58 user nova-compute[75097]:   <os>
Nov 14 16:05:58 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:05:58 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:05:58 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:05:58 user nova-compute[75097]:   </os>
Nov 14 16:05:58 user nova-compute[75097]:   <features>
Nov 14 16:05:58 user nova-compute[75097]:     <acpi/>
Nov 14 16:05:58 user nova-compute[75097]:     <apic/>
Nov 14 16:05:58 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:05:58 user nova-compute[75097]:   </features>
Nov 14 16:05:58 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:05:58 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:05:58 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:05:58 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:05:58 user nova-compute[75097]:   </clock>
Nov 14 16:05:58 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:05:58 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:05:58 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:05:58 user nova-compute[75097]:   </cpu>
Nov 14 16:05:58 user nova-compute[75097]:   <devices>
Nov 14 16:05:58 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:05:58 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:05:58 user nova-compute[75097]:       <source dev="/dev/sde"/>
Nov 14 16:05:58 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:05:58 user nova-compute[75097]:       <serial>ce70618b-8eed-4afe-9d95-08498ea3e605</serial>
Nov 14 16:05:58 user nova-compute[75097]:     </disk>
Nov 14 16:05:58 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:05:58 user nova-compute[75097]:       <mac address="fa:16:3e:54:e5:8d"/>
Nov 14 16:05:58 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:58 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:05:58 user nova-compute[75097]:       <target dev="tap43a2ed50-c7"/>
Nov 14 16:05:58 user nova-compute[75097]:     </interface>
Nov 14 16:05:58 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:05:58 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31/console.log" append="off"/>
Nov 14 16:05:58 user nova-compute[75097]:     </serial>
Nov 14 16:05:58 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:05:58 user nova-compute[75097]:     <video>
Nov 14 16:05:58 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:05:58 user nova-compute[75097]:     </video>
Nov 14 16:05:58 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:05:58 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:05:58 user nova-compute[75097]:     </rng>
Nov 14 16:05:58 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:05:58 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:05:58 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:05:58 user nova-compute[75097]:     </memballoon>
Nov 14 16:05:58 user nova-compute[75097]:   </devices>
Nov 14 16:05:58 user nova-compute[75097]: </domain>
Nov 14 16:05:58 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1193502518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1193502518',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkIvTZHy4KCWvjGUuzJP72IVTPtf+u/1pwxKhzdWAgjAFhtu7cSu8Q5VgjjvuqBIuu0k8oCSQG24jxFaMwkUeI6BwpC/rxUeyNW5Q1nvMARgKI51zUDpJhGjgzc0MkrhQ==',key_name='tempest-keypair-2065858370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb9642780d214f218f29ba0ecc8204f3',ramdisk_id='',reservation_id='r-yc0iaadf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1509095738',owner_user_name='tempest-ServerActionsV293TestJSON-1509095738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd73d9a3d5f3487b8fdccf2a46c3736d',uuid=c34dc8a1-71ab-491d-a915-6f8e1f4f1d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converting VIF {"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG os_vif [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cedf6154-ca77-5ae8-920f-257260fd4142', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43a2ed50-c7, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43a2ed50-c7, col_values=(('qos', UUID('f39c8d23-2a40-4428-80c5-a85686d8440b')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43a2ed50-c7, col_values=(('external_ids', {'iface-id': '43a2ed50-c777-4f1a-ae7f-f9b820c33fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:e5:8d', 'vm-uuid': 'c34dc8a1-71ab-491d-a915-6f8e1f4f1d31'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:58 user nova-compute[75097]: INFO os_vif [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7')
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:05:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] No VIF found with MAC fa:16:3e:54:e5:8d, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-74d972b6-5826-4709-bfe0-a5bfb734f3bc req-86521a47-f3fb-4b44-8fac-3f564967633f service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-74d972b6-5826-4709-bfe0-a5bfb734f3bc req-86521a47-f3fb-4b44-8fac-3f564967633f service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-74d972b6-5826-4709-bfe0-a5bfb734f3bc req-86521a47-f3fb-4b44-8fac-3f564967633f service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-74d972b6-5826-4709-bfe0-a5bfb734f3bc req-86521a47-f3fb-4b44-8fac-3f564967633f service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-74d972b6-5826-4709-bfe0-a5bfb734f3bc req-86521a47-f3fb-4b44-8fac-3f564967633f service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:05:59 user nova-compute[75097]: WARNING nova.compute.manager [req-74d972b6-5826-4709-bfe0-a5bfb734f3bc req-86521a47-f3fb-4b44-8fac-3f564967633f service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state building and task_state spawning.
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:05:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:01 user nova-compute[75097]: WARNING nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state building and task_state spawning.
Nov 14 16:06:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:01 user nova-compute[75097]: WARNING nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state building and task_state spawning.
Nov 14 16:06:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:01 user nova-compute[75097]: WARNING nova.compute.manager [req-d4238933-b50a-4015-8c5b-e4c77cc35a8e req-26456923-08d0-4a14-80de-f278b63288f3 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state building and task_state spawning.
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:06:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance spawned successfully.
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: INFO nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:06:02 user nova-compute[75097]: INFO nova.compute.manager [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Took 21.98 seconds to build instance.
Nov 14 16:06:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-473eec03-37dd-482f-9c4c-08598196bf09 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.099s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:06:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance spawned successfully.
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:03 user nova-compute[75097]: INFO nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 14 16:06:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:06:03 user nova-compute[75097]: INFO nova.compute.manager [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Took 13.34 seconds to build instance.
Nov 14 16:06:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c1b4c077-2521-4b7a-9d82-de942e8c8a6d tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.435s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:18 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d is timed out.
Nov 14 16:06:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully detached device vdb from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the live domain config.
Nov 14 16:06:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhUamVwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:18 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c2830-e4cd-4557-ac19-9e9f322337a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:06:18 user nova-compute[75097]: No targets found.
Nov 14 16:06:18 user nova-compute[75097]: iSNS:
Nov 14 16:06:18 user nova-compute[75097]: No targets found.
Nov 14 16:06:18 user nova-compute[75097]: STATIC:
Nov 14 16:06:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:06:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:06:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:06:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911
Nov 14 16:06:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:18 user nova-compute[75097]: FIRMWARE:
Nov 14 16:06:18 user nova-compute[75097]: No targets found.
Nov 14 16:06:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:06:18 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:06:18 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c842c6b-8138-41c8-b227-ccef3fdcbc34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed75e3f7-5e3a-4dd2-8212-069d936f75ac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:18 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:06:18 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:18 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:18 user nova-compute[75097]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 (non-flash)
Nov 14 16:06:18 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:18 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf786fce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3317c412-bd0b-426b-b316-7476dc1044fc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718388d-8c5d-45a2-8559-244516df5d88]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5024e-e33b-4836-a6c0-3075a1d31bfa]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfc1e70-127c-433e-92fb-f30143ff3078]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347f04c-7f5b-4e9f-a88b-3cdc8d948dae]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf672c5-0d7f-4a46-9d61-5a272ffe5a0b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260]
Nov 14 16:06:18 user nova-compute[75097]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911, portal: 172.16.0.220,3260] successful.
Nov 14 16:06:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fc8890f-a7f6-4aef-9257-3adfcc3f1911 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[666e3c45-3ac2-4330-8860-2d82e28a4c33]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] <== disconnect_volume: return (292ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:06:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:19 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'flavor' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f2513ad7-da17-40e0-8f3f-f7e71809e6f6 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.162s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "interface-9f739f81-f9a3-4b90-a99d-12bd82c3602d-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "interface-9f739f81-f9a3-4b90-a99d-12bd82c3602d-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'flavor' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface> {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface> {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Attempting to detach device tapfeb3ae8b-aa from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] detach device xml: <interface type="ethernet">
Nov 14 16:06:20 user nova-compute[75097]:   <mac address="fa:16:3e:f5:a9:d6"/>
Nov 14 16:06:20 user nova-compute[75097]:   <model type="virtio"/>
Nov 14 16:06:20 user nova-compute[75097]:   <mtu size="1442"/>
Nov 14 16:06:20 user nova-compute[75097]:   <target dev="tapfeb3ae8b-aa"/>
Nov 14 16:06:20 user nova-compute[75097]: </interface>
Nov 14 16:06:20 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface> {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 14 16:06:20 user nova-compute[75097]:   <name>instance-0000000f</name>
Nov 14 16:06:20 user nova-compute[75097]:   <uuid>9f739f81-f9a3-4b90-a99d-12bd82c3602d</uuid>
Nov 14 16:06:20 user nova-compute[75097]:   <metadata>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:20 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:06:20 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:06:20 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:05:46</nova:creationTime>
Nov 14 16:06:20 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:06:20 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:20 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:06:20 user nova-compute[75097]:   <nova:owner>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:06:20 user nova-compute[75097]:   </nova:owner>
Nov 14 16:06:20 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:20 user nova-compute[75097]:   <nova:ports>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:06:20 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:06:20 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:20 user nova-compute[75097]:     <nova:port uuid="feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7">
Nov 14 16:06:20 user nova-compute[75097]:       <nova:ip type="fixed" address="10.10.10.20" ipVersion="4"/>
Nov 14 16:06:20 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:20 user nova-compute[75097]:   </nova:ports>
Nov 14 16:06:20 user nova-compute[75097]: </nova:instance>
Nov 14 16:06:20 user nova-compute[75097]:   </metadata>
Nov 14 16:06:20 user nova-compute[75097]:   <memory unit='KiB'>524288</memory>
Nov 14 16:06:20 user nova-compute[75097]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 16:06:20 user nova-compute[75097]:   <vcpu placement='static'>1</vcpu>
Nov 14 16:06:20 user nova-compute[75097]:   <resource>
Nov 14 16:06:20 user nova-compute[75097]:     <partition>/machine</partition>
Nov 14 16:06:20 user nova-compute[75097]:   </resource>
Nov 14 16:06:20 user nova-compute[75097]:   <sysinfo type='smbios'>
Nov 14 16:06:20 user nova-compute[75097]:     <system>
Nov 14 16:06:20 user nova-compute[75097]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 16:06:20 user nova-compute[75097]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 16:06:20 user nova-compute[75097]:       <entry name='version'>0.0.0</entry>
Nov 14 16:06:20 user nova-compute[75097]:       <entry name='serial'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:20 user nova-compute[75097]:       <entry name='uuid'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:20 user nova-compute[75097]:       <entry name='family'>Virtual Machine</entry>
Nov 14 16:06:20 user nova-compute[75097]:     </system>
Nov 14 16:06:20 user nova-compute[75097]:   </sysinfo>
Nov 14 16:06:20 user nova-compute[75097]:   <os>
Nov 14 16:06:20 user nova-compute[75097]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 16:06:20 user nova-compute[75097]:     <boot dev='hd'/>
Nov 14 16:06:20 user nova-compute[75097]:     <smbios mode='sysinfo'/>
Nov 14 16:06:20 user nova-compute[75097]:   </os>
Nov 14 16:06:20 user nova-compute[75097]:   <features>
Nov 14 16:06:20 user nova-compute[75097]:     <acpi/>
Nov 14 16:06:20 user nova-compute[75097]:     <apic/>
Nov 14 16:06:20 user nova-compute[75097]:     <vmcoreinfo state='on'/>
Nov 14 16:06:20 user nova-compute[75097]:   </features>
Nov 14 16:06:20 user nova-compute[75097]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 16:06:20 user nova-compute[75097]:     <model fallback='forbid'>Nehalem</model>
Nov 14 16:06:20 user nova-compute[75097]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 16:06:20 user nova-compute[75097]:     <feature policy='require' name='vme'/>
Nov 14 16:06:20 user nova-compute[75097]:     <feature policy='require' name='x2apic'/>
Nov 14 16:06:20 user nova-compute[75097]:     <feature policy='require' name='hypervisor'/>
Nov 14 16:06:20 user nova-compute[75097]:   </cpu>
Nov 14 16:06:20 user nova-compute[75097]:   <clock offset='utc'>
Nov 14 16:06:20 user nova-compute[75097]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 16:06:20 user nova-compute[75097]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 16:06:20 user nova-compute[75097]:     <timer name='hpet' present='no'/>
Nov 14 16:06:20 user nova-compute[75097]:   </clock>
Nov 14 16:06:20 user nova-compute[75097]:   <on_poweroff>destroy</on_poweroff>
Nov 14 16:06:20 user nova-compute[75097]:   <on_reboot>restart</on_reboot>
Nov 14 16:06:20 user nova-compute[75097]:   <on_crash>destroy</on_crash>
Nov 14 16:06:20 user nova-compute[75097]:   <devices>
Nov 14 16:06:20 user nova-compute[75097]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 16:06:20 user nova-compute[75097]:     <disk type='file' device='disk'>
Nov 14 16:06:20 user nova-compute[75097]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 16:06:20 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk' index='2'/>
Nov 14 16:06:20 user nova-compute[75097]:       <backingStore type='file' index='3'>
Nov 14 16:06:20 user nova-compute[75097]:         <format type='raw'/>
Nov 14 16:06:20 user nova-compute[75097]:         <source file='/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee'/>
Nov 14 16:06:20 user nova-compute[75097]:         <backingStore/>
Nov 14 16:06:20 user nova-compute[75097]:       </backingStore>
Nov 14 16:06:20 user nova-compute[75097]:       <target dev='vda' bus='virtio'/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='virtio-disk0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </disk>
Nov 14 16:06:20 user nova-compute[75097]:     <disk type='file' device='cdrom'>
Nov 14 16:06:20 user nova-compute[75097]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 16:06:20 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config' index='1'/>
Nov 14 16:06:20 user nova-compute[75097]:       <backingStore/>
Nov 14 16:06:20 user nova-compute[75097]:       <target dev='hda' bus='ide'/>
Nov 14 16:06:20 user nova-compute[75097]:       <readonly/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='ide0-0-0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </disk>
Nov 14 16:06:20 user nova-compute[75097]:     <controller type='usb' index='0' model='none'>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='usb'/>
Nov 14 16:06:20 user nova-compute[75097]:     </controller>
Nov 14 16:06:20 user nova-compute[75097]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='pci.0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </controller>
Nov 14 16:06:20 user nova-compute[75097]:     <controller type='ide' index='0'>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='ide'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 16:06:20 user nova-compute[75097]:     </controller>
Nov 14 16:06:20 user nova-compute[75097]:     <interface type='ethernet'>
Nov 14 16:06:20 user nova-compute[75097]:       <mac address='fa:16:3e:6b:82:67'/>
Nov 14 16:06:20 user nova-compute[75097]:       <target dev='tap0297ecfb-74'/>
Nov 14 16:06:20 user nova-compute[75097]:       <model type='virtio'/>
Nov 14 16:06:20 user nova-compute[75097]:       <mtu size='1442'/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='net0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </interface>
Nov 14 16:06:20 user nova-compute[75097]:     <interface type='ethernet'>
Nov 14 16:06:20 user nova-compute[75097]:       <mac address='fa:16:3e:f5:a9:d6'/>
Nov 14 16:06:20 user nova-compute[75097]:       <target dev='tapfeb3ae8b-aa'/>
Nov 14 16:06:20 user nova-compute[75097]:       <model type='virtio'/>
Nov 14 16:06:20 user nova-compute[75097]:       <mtu size='1442'/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='net1'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </interface>
Nov 14 16:06:20 user nova-compute[75097]:     <serial type='pty'>
Nov 14 16:06:20 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:20 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:20 user nova-compute[75097]:       <target type='isa-serial' port='0'>
Nov 14 16:06:20 user nova-compute[75097]:         <model name='isa-serial'/>
Nov 14 16:06:20 user nova-compute[75097]:       </target>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </serial>
Nov 14 16:06:20 user nova-compute[75097]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 16:06:20 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:20 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:20 user nova-compute[75097]:       <target type='serial' port='0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </console>
Nov 14 16:06:20 user nova-compute[75097]:     <input type='mouse' bus='ps2'>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='input0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </input>
Nov 14 16:06:20 user nova-compute[75097]:     <input type='keyboard' bus='ps2'>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='input1'/>
Nov 14 16:06:20 user nova-compute[75097]:     </input>
Nov 14 16:06:20 user nova-compute[75097]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 14 16:06:20 user nova-compute[75097]:       <listen type='address' address='0.0.0.0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </graphics>
Nov 14 16:06:20 user nova-compute[75097]:     <audio id='1' type='none'/>
Nov 14 16:06:20 user nova-compute[75097]:     <video>
Nov 14 16:06:20 user nova-compute[75097]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='video0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </video>
Nov 14 16:06:20 user nova-compute[75097]:     <memballoon model='virtio'>
Nov 14 16:06:20 user nova-compute[75097]:       <stats period='10'/>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='balloon0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </memballoon>
Nov 14 16:06:20 user nova-compute[75097]:     <rng model='virtio'>
Nov 14 16:06:20 user nova-compute[75097]:       <backend model='random'>/dev/urandom</backend>
Nov 14 16:06:20 user nova-compute[75097]:       <alias name='rng0'/>
Nov 14 16:06:20 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 16:06:20 user nova-compute[75097]:     </rng>
Nov 14 16:06:20 user nova-compute[75097]:   </devices>
Nov 14 16:06:20 user nova-compute[75097]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 16:06:20 user nova-compute[75097]:     <label>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</label>
Nov 14 16:06:20 user nova-compute[75097]:     <imagelabel>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</imagelabel>
Nov 14 16:06:20 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:20 user nova-compute[75097]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 16:06:20 user nova-compute[75097]:     <label>+64055:+108</label>
Nov 14 16:06:20 user nova-compute[75097]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 16:06:20 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:20 user nova-compute[75097]: </domain>
Nov 14 16:06:20 user nova-compute[75097]:  {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 16:06:20 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully detached device tapfeb3ae8b-aa from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the persistent domain config.
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] (1/8): Attempting to detach device tapfeb3ae8b-aa with device alias net1 from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] detach device xml: <interface type="ethernet">
Nov 14 16:06:20 user nova-compute[75097]:   <mac address="fa:16:3e:f5:a9:d6"/>
Nov 14 16:06:20 user nova-compute[75097]:   <model type="virtio"/>
Nov 14 16:06:20 user nova-compute[75097]:   <mtu size="1442"/>
Nov 14 16:06:20 user nova-compute[75097]:   <target dev="tapfeb3ae8b-aa"/>
Nov 14 16:06:20 user nova-compute[75097]: </interface>
Nov 14 16:06:20 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Start waiting for the detach event from libvirt for device tapfeb3ae8b-aa with device alias net1 for instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-6bc0ef94-dae2-44b7-9a1c-efa080342505 req-4fb25258-6d5f-4e1d-852e-34a27d916e2e service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-unplugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6bc0ef94-dae2-44b7-9a1c-efa080342505 req-4fb25258-6d5f-4e1d-852e-34a27d916e2e service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6bc0ef94-dae2-44b7-9a1c-efa080342505 req-4fb25258-6d5f-4e1d-852e-34a27d916e2e service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6bc0ef94-dae2-44b7-9a1c-efa080342505 req-4fb25258-6d5f-4e1d-852e-34a27d916e2e service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-6bc0ef94-dae2-44b7-9a1c-efa080342505 req-4fb25258-6d5f-4e1d-852e-34a27d916e2e service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-unplugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:20 user nova-compute[75097]: WARNING nova.compute.manager [req-6bc0ef94-dae2-44b7-9a1c-efa080342505 req-4fb25258-6d5f-4e1d-852e-34a27d916e2e service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-unplugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 for instance with vm_state active and task_state None.
Nov 14 16:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:23 user nova-compute[75097]: WARNING nova.compute.manager [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 for instance with vm_state active and task_state None.
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-changed-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Refreshing instance network info cache due to event network-changed-942f59ad-3b4f-4545-ab74-de84dbf0e786. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] Acquiring lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] Acquired lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.network.neutron [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Refreshing network info cache for port 942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'flavor' on Instance uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:23 user nova-compute[75097]: INFO nova.compute.manager [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attaching volume 13e87877-2380-48a3-894d-58955eca5e67 to /dev/vdb
Nov 14 16:06:23 user nova-compute[75097]: DEBUG os_brick.utils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c9aa48-db03-4e49-87ff-7b118e80d4ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1764a-b2ad-4067-8cdd-57d0687630e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.network.neutron [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updated VIF entry in instance network info cache for port 942f59ad-3b4f-4545-ab74-de84dbf0e786. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.network.neutron [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updating instance_info_cache with network_info: [{"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6c016c-9504-455e-b94a-84428840b94f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a7690-7949-444d-8bf1-3c5c89948d5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b1e3ece5-d2f7-4009-93d8-e003285f641a req-615484d1-6f1f-40e9-afac-02509a3e313b service nova] Releasing lock "refresh_cache-f4eb61fa-ad89-4fad-b649-869efa6043c0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:06:23 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:06:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d060a-4678-4d0d-ae42-64cfae64e593]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG os_brick.utils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updating existing volume attachment record: f9d18f3b-e035-47a2-8153-e90a57254488 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:06:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:27 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:27 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:27 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3913f9cc-18b2-4ea0-a560-80a8fc837f38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:06:27 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d49357-9f8e-443b-abb9-4009f7af1aa8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67] added
Nov 14 16:06:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.103s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b70f73-37a4-45d4-9564-04984c8167d4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.080s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1966b0-f226-40b2-98ae-b5eed881e932]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHpcPar {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHpcPar" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53abf67-f1fa-4a52-beef-6e5a2786b375]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkHpcPar'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6574ac1-409a-4478-a21d-df221d2dd692]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c7dce-b271-440b-bfda-e12030f0f534]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.147s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864a4a1-754b-4a1b-820d-08cbd0d18501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]
Nov 14 16:06:28 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.
Nov 14 16:06:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9111d172-4a80-4f62-8f7a-c962d44077ea]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d5914b-6d7a-4aa6-8229-2274a27332b8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.609s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.155s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f4a965-55ca-4e7f-9abf-fa0c9bfa8fb4]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:06:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:06:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.786s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== connect_volume: return (1787ms) {'type': 'block', 'scsi_wwn': '26133333237376462', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133333237376462', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'flavor' on Instance uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:06:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:06:30 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:06:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:06:30 user nova-compute[75097]:   <serial>13e87877-2380-48a3-894d-58955eca5e67</serial>
Nov 14 16:06:30 user nova-compute[75097]: </disk>
Nov 14 16:06:30 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No VIF found with MAC fa:16:3e:a8:3f:85, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:06:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bea88d6e-3a8a-435b-8d2e-6a8bde649799 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.277s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:31 user nova-compute[75097]: INFO nova.compute.manager [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Rebuilding instance
Nov 14 16:06:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd8e3b28-6e5c-4a45-a4d3-73dc2d1ae4dd req-ae96aae2-5dae-4949-b617-242c4bffba60 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-unplugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd8e3b28-6e5c-4a45-a4d3-73dc2d1ae4dd req-ae96aae2-5dae-4949-b617-242c4bffba60 service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd8e3b28-6e5c-4a45-a4d3-73dc2d1ae4dd req-ae96aae2-5dae-4949-b617-242c4bffba60 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd8e3b28-6e5c-4a45-a4d3-73dc2d1ae4dd req-ae96aae2-5dae-4949-b617-242c4bffba60 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd8e3b28-6e5c-4a45-a4d3-73dc2d1ae4dd req-ae96aae2-5dae-4949-b617-242c4bffba60 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-unplugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:32 user nova-compute[75097]: WARNING nova.compute.manager [req-cd8e3b28-6e5c-4a45-a4d3-73dc2d1ae4dd req-ae96aae2-5dae-4949-b617-242c4bffba60 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-unplugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state active and task_state rebuilding.
Nov 14 16:06:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance destroyed successfully.
Nov 14 16:06:32 user nova-compute[75097]: INFO nova.compute.manager [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Detaching volume 13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:06:32 user nova-compute[75097]: INFO nova.virt.block_device [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attempting to driver detach volume 13e87877-2380-48a3-894d-58955eca5e67 from mountpoint /dev/vdb
Nov 14 16:06:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Attempting to detach device vdb from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:06:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:06:32 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:06:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:06:32 user nova-compute[75097]:   <serial>13e87877-2380-48a3-894d-58955eca5e67</serial>
Nov 14 16:06:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:06:32 user nova-compute[75097]: </disk>
Nov 14 16:06:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:06:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully detached device vdb from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 from the persistent domain config.
Nov 14 16:06:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:32 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e575e1-9ca3-42ea-a0a7-1d25b7411202]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:06:32 user nova-compute[75097]: No targets found.
Nov 14 16:06:32 user nova-compute[75097]: iSNS:
Nov 14 16:06:32 user nova-compute[75097]: No targets found.
Nov 14 16:06:32 user nova-compute[75097]: STATIC:
Nov 14 16:06:32 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:06:32 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:32 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:32 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:06:32 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:32 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:32 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:06:32 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:32 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:32 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:06:32 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:32 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:32 user nova-compute[75097]: FIRMWARE:
Nov 14 16:06:32 user nova-compute[75097]: No targets found.
Nov 14 16:06:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:06:32 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:06:32 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f909a5-a1a8-481d-9dc5-1d9a0d6df743]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c5720c-165f-4830-8a95-b90bb0ba22e3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:32 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:32 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:32 user nova-compute[75097]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:32 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:32 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:32 user nova-compute[75097]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00f809-b43e-467e-9efa-bf1dbef96232]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e42c78-933c-4f50-bef9-c8ad210ae0e4]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab9955-03e0-47e5-ac48-e8b710dda406]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d4d61-495b-4dbb-8e5c-0206b8dc5b67]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[40df347c-7718-43ab-917d-3aec2e61c92d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d97d9f-829a-4350-a0d4-ce7d36db438f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]
Nov 14 16:06:32 user nova-compute[75097]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.
Nov 14 16:06:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ee6e3e-8eed-4458-b473-d2e97631ef7d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== disconnect_volume: return (303ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Port 665262a2-60e0-4453-aa2e-2e6373bc86cf binding to destination host user is already ACTIVE {{(pid=75097) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Creating tmpfile /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/tmp_vcwoc2z to verify with other compute node that the instance is on the same shared storage. {{(pid=75097) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 16:06:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance destroyed successfully.
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1600934682',display_name='tempest-ServerActionsTestOtherA-server-262853361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1600934682',id=17,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSXJJUSODFI4cAb2k9NEktgfAYWMb0LkasDxu0ebPJq3WK3O4/dIQAma25q1DmS8B+ZzHbyX8Dm37qKQvD1tndswkqegWiKxemgPlClz7T4zTEGctOcBZhCgUAj4Hjbg==',key_name='tempest-keypair-1661349674',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:04:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-ulnvtc04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=f4eb61fa-ad89-4fad-b649-869efa6043c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap942f59ad-3b, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=293e0253-bea3-47fe-9712-a5c824dbe47d) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:33 user nova-compute[75097]: INFO os_vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b')
Nov 14 16:06:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:33 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5560e7aa-91b2-42b5-9a6d-5a91fbb81391]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:06:33 user nova-compute[75097]: No targets found.
Nov 14 16:06:33 user nova-compute[75097]: iSNS:
Nov 14 16:06:33 user nova-compute[75097]: No targets found.
Nov 14 16:06:33 user nova-compute[75097]: STATIC:
Nov 14 16:06:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:06:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:06:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:06:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:33 user nova-compute[75097]: FIRMWARE:
Nov 14 16:06:33 user nova-compute[75097]: No targets found.
Nov 14 16:06:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:06:33 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:06:33 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f18193-2d72-4d63-922f-e6348c916fe3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae563e82-438a-4fd9-a035-8bcd9103875a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981d4a60>, {}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Disconnecting from: [] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== disconnect_volume: return (74ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:06:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Deleting instance files /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0_del
Nov 14 16:06:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Deletion of /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0_del complete
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-8948defe-8931-46aa-a8b7-a665f3bebc4b req-f8657055-a583-49de-927d-448dcad72821 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8948defe-8931-46aa-a8b7-a665f3bebc4b req-f8657055-a583-49de-927d-448dcad72821 service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8948defe-8931-46aa-a8b7-a665f3bebc4b req-f8657055-a583-49de-927d-448dcad72821 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8948defe-8931-46aa-a8b7-a665f3bebc4b req-f8657055-a583-49de-927d-448dcad72821 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-8948defe-8931-46aa-a8b7-a665f3bebc4b req-f8657055-a583-49de-927d-448dcad72821 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:34 user nova-compute[75097]: WARNING nova.compute.manager [req-8948defe-8931-46aa-a8b7-a665f3bebc4b req-f8657055-a583-49de-927d-448dcad72821 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state active and task_state rebuilding.
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-1c39e01c-bde4-4220-a9ae-ee0eddaf3fe8 req-ebdcc5e7-fc66-4870-941a-5aa12b688559 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1c39e01c-bde4-4220-a9ae-ee0eddaf3fe8 req-ebdcc5e7-fc66-4870-941a-5aa12b688559 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1c39e01c-bde4-4220-a9ae-ee0eddaf3fe8 req-ebdcc5e7-fc66-4870-941a-5aa12b688559 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1c39e01c-bde4-4220-a9ae-ee0eddaf3fe8 req-ebdcc5e7-fc66-4870-941a-5aa12b688559 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-1c39e01c-bde4-4220-a9ae-ee0eddaf3fe8 req-ebdcc5e7-fc66-4870-941a-5aa12b688559 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:34 user nova-compute[75097]: WARNING nova.compute.manager [req-1c39e01c-bde4-4220-a9ae-ee0eddaf3fe8 req-ebdcc5e7-fc66-4870-941a-5aa12b688559 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state resized and task_state resize_reverting.
Nov 14 16:06:34 user nova-compute[75097]: INFO nova.virt.block_device [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Booting with volume 13e87877-2380-48a3-894d-58955eca5e67 at /dev/vdb
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.utils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f10e3c3-d984-48df-899c-1ac8d6119af3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2707c3b3-ccc9-408d-ad83-a2b87a4e777a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb5c6ee-6adb-4300-a85d-041769812cfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5853cd7c-9de2-456a-8ad4-e9788016798d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:06:34 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f545a6-f75c-423c-b1bc-726320373d93]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.utils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updating existing volume attachment record: bc6ab99d-ba93-4217-ab6e-0ff1d0998162 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:06:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance destroyed successfully.
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'resources' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap665262a2-60, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d62e56f-befb-477b-931c-0766c15d3ece) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:34 user nova-compute[75097]: INFO os_vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60')
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:34 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab16e19c-88a8-4e00-923a-20d4ea24f73d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:06:34 user nova-compute[75097]: No targets found.
Nov 14 16:06:34 user nova-compute[75097]: iSNS:
Nov 14 16:06:34 user nova-compute[75097]: No targets found.
Nov 14 16:06:34 user nova-compute[75097]: STATIC:
Nov 14 16:06:34 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:06:34 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:34 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:34 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:06:34 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:34 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:34 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:06:34 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:06:34 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:06:34 user nova-compute[75097]: FIRMWARE:
Nov 14 16:06:34 user nova-compute[75097]: No targets found.
Nov 14 16:06:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:06:34 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:06:34 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aab6f0-8f2f-4ab3-96d3-fd52aa40fb89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b5b3ed-860e-4552-8084-273c1199815e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9825d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2e1b6d-3ad7-47b2-8092-41e932ddbaa0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbf928a-c3be-482e-bf1e-f35180bfeb5a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ccbdb3-b874-4db2-b92a-180066d5fb37]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771dc97-3e6e-4615-b55a-7922edb33d8c]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[530f6e46-4fa9-4e50-a652-6960c2357599]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e45c3-d63e-4cbc-8b3e-c04f8ce88f5d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]
Nov 14 16:06:34 user nova-compute[75097]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.
Nov 14 16:06:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[096053df-95fa-45b6-8606-035a5c133d37]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== disconnect_volume: return (323ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'migration_context' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG nova.objects.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Object Instance<0eaff6ee-9806-4f4b-9492-ccc8328a63e0> lazy-loaded attributes: resources,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-1e2d4db9-dd19-48de-b7ab-1ef77dc1dfdf req-64f210cb-736f-496b-983e-833b62f4a035 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1e2d4db9-dd19-48de-b7ab-1ef77dc1dfdf req-64f210cb-736f-496b-983e-833b62f4a035 service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1e2d4db9-dd19-48de-b7ab-1ef77dc1dfdf req-64f210cb-736f-496b-983e-833b62f4a035 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1e2d4db9-dd19-48de-b7ab-1ef77dc1dfdf req-64f210cb-736f-496b-983e-833b62f4a035 service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-1e2d4db9-dd19-48de-b7ab-1ef77dc1dfdf req-64f210cb-736f-496b-983e-833b62f4a035 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:36 user nova-compute[75097]: WARNING nova.compute.manager [req-1e2d4db9-dd19-48de-b7ab-1ef77dc1dfdf req-64f210cb-736f-496b-983e-833b62f4a035 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state resized and task_state resize_reverting.
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:36 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '0eaff6ee-9806-4f4b-9492-ccc8328a63e0' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '0eaff6ee-9806-4f4b-9492-ccc8328a63e0' (instance-00000005)
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.663s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:36 user nova-compute[75097]: INFO nova.compute.manager [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Swapping old allocation on dict_keys(['321f3c0d-b8ec-4f98-bbbb-009e84ae5816']) held by migration e8297787-41a8-4a18-aa0f-dc533a5f6179 for instance
Nov 14 16:06:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Overwriting current allocation {'allocations': {'321f3c0d-b8ec-4f98-bbbb-009e84ae5816': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '0301ebf075c14cee925c28d1e74b1598', 'user_id': '257dfabc0d374fdcaf4897d360547fb5', 'consumer_generation': 1} on consumer 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquired lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Releasing lock "refresh_cache-0eaff6ee-9806-4f4b-9492-ccc8328a63e0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG os_brick.utils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a5afe3-e361-4541-bef4-bff48c028370]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22fce7d-4278-4e3e-969b-3d82dc3878ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1fac92-8149-4f19-97d9-924f9c0793e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd13b9c4-c3ea-48b8-9412-c2262538634e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:06:37 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d39de36-ab80-42d4-b8c9-47a19f19b2e6]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG os_brick.utils [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:06:38 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:06:38 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=25.325733184814453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 34098dea-702d-454d-af5e-35b51cac9bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f4eb61fa-ad89-4fad-b649-869efa6043c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 17946bc0-ba29-42a0-8993-74699b98d836 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:06:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Creating image(s)
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.258s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk 1073741824" returned: 0 in 0.046s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.907s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Cannot resize image /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Ensure instance console log exists: /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Start _get_guest_xml network_info=[{"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f4eb61fa-ad89-4fad-b649-869efa6043c0', 'attached_at': '', 'detached_at': '', 'volume_id': '13e87877-2380-48a3-894d-58955eca5e67', 'serial': '13e87877-2380-48a3-894d-58955eca5e67'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'bc6ab99d-ba93-4217-ab6e-0ff1d0998162', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:06:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 16:06:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:39 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:39 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:39 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4730dc93-d337-431b-8b6e-95ecbf909c09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:06:39 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d5247d-e64e-4d9e-a6f7-81b29e3caa55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67] added
Nov 14 16:06:39 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e7f99-848a-4695-80fb-247cd4a9958e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.118s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd341c05-150b-49fa-a728-50d0b76fe8cd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHpcPar {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHpcPar" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439d14d-7963-4c21-a751-331e50e30149]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkHpcPar'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8605af-ceb5-438b-8e7b-e26b7d3cf418]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f2faab-e554-4cad-9f94-426f6e6c3b88]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546b379-2d73-493c-b1e9-8c5bc22dee31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]
Nov 14 16:06:40 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.
Nov 14 16:06:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed98a835-8823-4423-8b3e-b6c7075fef7e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f7ed55-36d4-4021-bf6e-53e2441bde6d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b46cb-5587-44d4-8a3a-710069d8af2b]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:06:40 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Waiting for libvirt event about the detach of device tapfeb3ae8b-aa with device alias net1 from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d is timed out.
Nov 14 16:06:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface> {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 14 16:06:40 user nova-compute[75097]:   <name>instance-0000000f</name>
Nov 14 16:06:40 user nova-compute[75097]:   <uuid>9f739f81-f9a3-4b90-a99d-12bd82c3602d</uuid>
Nov 14 16:06:40 user nova-compute[75097]:   <metadata>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:40 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:05:46</nova:creationTime>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:06:40 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:40 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:owner>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:06:40 user nova-compute[75097]:   </nova:owner>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:ports>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:06:40 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:06:40 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:port uuid="feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7">
Nov 14 16:06:40 user nova-compute[75097]:       <nova:ip type="fixed" address="10.10.10.20" ipVersion="4"/>
Nov 14 16:06:40 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:40 user nova-compute[75097]:   </nova:ports>
Nov 14 16:06:40 user nova-compute[75097]: </nova:instance>
Nov 14 16:06:40 user nova-compute[75097]:   </metadata>
Nov 14 16:06:40 user nova-compute[75097]:   <memory unit='KiB'>524288</memory>
Nov 14 16:06:40 user nova-compute[75097]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 16:06:40 user nova-compute[75097]:   <vcpu placement='static'>1</vcpu>
Nov 14 16:06:40 user nova-compute[75097]:   <resource>
Nov 14 16:06:40 user nova-compute[75097]:     <partition>/machine</partition>
Nov 14 16:06:40 user nova-compute[75097]:   </resource>
Nov 14 16:06:40 user nova-compute[75097]:   <sysinfo type='smbios'>
Nov 14 16:06:40 user nova-compute[75097]:     <system>
Nov 14 16:06:40 user nova-compute[75097]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 16:06:40 user nova-compute[75097]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 16:06:40 user nova-compute[75097]:       <entry name='version'>0.0.0</entry>
Nov 14 16:06:40 user nova-compute[75097]:       <entry name='serial'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:40 user nova-compute[75097]:       <entry name='uuid'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:40 user nova-compute[75097]:       <entry name='family'>Virtual Machine</entry>
Nov 14 16:06:40 user nova-compute[75097]:     </system>
Nov 14 16:06:40 user nova-compute[75097]:   </sysinfo>
Nov 14 16:06:40 user nova-compute[75097]:   <os>
Nov 14 16:06:40 user nova-compute[75097]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 16:06:40 user nova-compute[75097]:     <boot dev='hd'/>
Nov 14 16:06:40 user nova-compute[75097]:     <smbios mode='sysinfo'/>
Nov 14 16:06:40 user nova-compute[75097]:   </os>
Nov 14 16:06:40 user nova-compute[75097]:   <features>
Nov 14 16:06:40 user nova-compute[75097]:     <acpi/>
Nov 14 16:06:40 user nova-compute[75097]:     <apic/>
Nov 14 16:06:40 user nova-compute[75097]:     <vmcoreinfo state='on'/>
Nov 14 16:06:40 user nova-compute[75097]:   </features>
Nov 14 16:06:40 user nova-compute[75097]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 16:06:40 user nova-compute[75097]:     <model fallback='forbid'>Nehalem</model>
Nov 14 16:06:40 user nova-compute[75097]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 16:06:40 user nova-compute[75097]:     <feature policy='require' name='vme'/>
Nov 14 16:06:40 user nova-compute[75097]:     <feature policy='require' name='x2apic'/>
Nov 14 16:06:40 user nova-compute[75097]:     <feature policy='require' name='hypervisor'/>
Nov 14 16:06:40 user nova-compute[75097]:   </cpu>
Nov 14 16:06:40 user nova-compute[75097]:   <clock offset='utc'>
Nov 14 16:06:40 user nova-compute[75097]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 16:06:40 user nova-compute[75097]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 16:06:40 user nova-compute[75097]:     <timer name='hpet' present='no'/>
Nov 14 16:06:40 user nova-compute[75097]:   </clock>
Nov 14 16:06:40 user nova-compute[75097]:   <on_poweroff>destroy</on_poweroff>
Nov 14 16:06:40 user nova-compute[75097]:   <on_reboot>restart</on_reboot>
Nov 14 16:06:40 user nova-compute[75097]:   <on_crash>destroy</on_crash>
Nov 14 16:06:40 user nova-compute[75097]:   <devices>
Nov 14 16:06:40 user nova-compute[75097]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 16:06:40 user nova-compute[75097]:     <disk type='file' device='disk'>
Nov 14 16:06:40 user nova-compute[75097]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 16:06:40 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk' index='2'/>
Nov 14 16:06:40 user nova-compute[75097]:       <backingStore type='file' index='3'>
Nov 14 16:06:40 user nova-compute[75097]:         <format type='raw'/>
Nov 14 16:06:40 user nova-compute[75097]:         <source file='/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee'/>
Nov 14 16:06:40 user nova-compute[75097]:         <backingStore/>
Nov 14 16:06:40 user nova-compute[75097]:       </backingStore>
Nov 14 16:06:40 user nova-compute[75097]:       <target dev='vda' bus='virtio'/>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='virtio-disk0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </disk>
Nov 14 16:06:40 user nova-compute[75097]:     <disk type='file' device='cdrom'>
Nov 14 16:06:40 user nova-compute[75097]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 16:06:40 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config' index='1'/>
Nov 14 16:06:40 user nova-compute[75097]:       <backingStore/>
Nov 14 16:06:40 user nova-compute[75097]:       <target dev='hda' bus='ide'/>
Nov 14 16:06:40 user nova-compute[75097]:       <readonly/>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='ide0-0-0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </disk>
Nov 14 16:06:40 user nova-compute[75097]:     <controller type='usb' index='0' model='none'>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='usb'/>
Nov 14 16:06:40 user nova-compute[75097]:     </controller>
Nov 14 16:06:40 user nova-compute[75097]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='pci.0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </controller>
Nov 14 16:06:40 user nova-compute[75097]:     <controller type='ide' index='0'>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='ide'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 16:06:40 user nova-compute[75097]:     </controller>
Nov 14 16:06:40 user nova-compute[75097]:     <interface type='ethernet'>
Nov 14 16:06:40 user nova-compute[75097]:       <mac address='fa:16:3e:6b:82:67'/>
Nov 14 16:06:40 user nova-compute[75097]:       <target dev='tap0297ecfb-74'/>
Nov 14 16:06:40 user nova-compute[75097]:       <model type='virtio'/>
Nov 14 16:06:40 user nova-compute[75097]:       <mtu size='1442'/>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='net0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </interface>
Nov 14 16:06:40 user nova-compute[75097]:     <serial type='pty'>
Nov 14 16:06:40 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:40 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:40 user nova-compute[75097]:       <target type='isa-serial' port='0'>
Nov 14 16:06:40 user nova-compute[75097]:         <model name='isa-serial'/>
Nov 14 16:06:40 user nova-compute[75097]:       </target>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </serial>
Nov 14 16:06:40 user nova-compute[75097]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 16:06:40 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:40 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:40 user nova-compute[75097]:       <target type='serial' port='0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </console>
Nov 14 16:06:40 user nova-compute[75097]:     <input type='mouse' bus='ps2'>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='input0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </input>
Nov 14 16:06:40 user nova-compute[75097]:     <input type='keyboard' bus='ps2'>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='input1'/>
Nov 14 16:06:40 user nova-compute[75097]:     </input>
Nov 14 16:06:40 user nova-compute[75097]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 14 16:06:40 user nova-compute[75097]:       <listen type='address' address='0.0.0.0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </graphics>
Nov 14 16:06:40 user nova-compute[75097]:     <audio id='1' type='none'/>
Nov 14 16:06:40 user nova-compute[75097]:     <video>
Nov 14 16:06:40 user nova-compute[75097]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='video0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </video>
Nov 14 16:06:40 user nova-compute[75097]:     <memballoon model='virtio'>
Nov 14 16:06:40 user nova-compute[75097]:       <stats period='10'/>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='balloon0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </memballoon>
Nov 14 16:06:40 user nova-compute[75097]:     <rng model='virtio'>
Nov 14 16:06:40 user nova-compute[75097]:       <backend model='random'>/dev/urandom</backend>
Nov 14 16:06:40 user nova-compute[75097]:       <alias name='rng0'/>
Nov 14 16:06:40 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 16:06:40 user nova-compute[75097]:     </rng>
Nov 14 16:06:40 user nova-compute[75097]:   </devices>
Nov 14 16:06:40 user nova-compute[75097]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 16:06:40 user nova-compute[75097]:     <label>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</label>
Nov 14 16:06:40 user nova-compute[75097]:     <imagelabel>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</imagelabel>
Nov 14 16:06:40 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:40 user nova-compute[75097]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 16:06:40 user nova-compute[75097]:     <label>+64055:+108</label>
Nov 14 16:06:40 user nova-compute[75097]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 16:06:40 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:40 user nova-compute[75097]: </domain>
Nov 14 16:06:40 user nova-compute[75097]:  {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 16:06:40 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully detached device tapfeb3ae8b-aa from instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d from the live domain config.
Nov 14 16:06:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG os_vif [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeb3ae8b-aa, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba09b920-a302-4e1f-a8c7-bbe366eb7b8d) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:40 user nova-compute[75097]: INFO os_vif [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa')
Nov 14 16:06:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:40 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:06:40</nova:creationTime>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:06:40 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:40 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:owner>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:06:40 user nova-compute[75097]:   </nova:owner>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:40 user nova-compute[75097]:   <nova:ports>
Nov 14 16:06:40 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:06:40 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:06:40 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:40 user nova-compute[75097]:   </nova:ports>
Nov 14 16:06:40 user nova-compute[75097]: </nova:instance>
Nov 14 16:06:40 user nova-compute[75097]:  {{(pid=75097) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26133333237376462', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133333237376462', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1600934682',display_name='tempest-ServerActionsTestOtherA-server-262853361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1600934682',id=17,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSXJJUSODFI4cAb2k9NEktgfAYWMb0LkasDxu0ebPJq3WK3O4/dIQAma25q1DmS8B+ZzHbyX8Dm37qKQvD1tndswkqegWiKxemgPlClz7T4zTEGctOcBZhCgUAj4Hjbg==',key_name='tempest-keypair-1661349674',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:04:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-ulnvtc04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=f4eb61fa-ad89-4fad-b649-869efa6043c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:06:41 user nova-compute[75097]:   <uuid>f4eb61fa-ad89-4fad-b649-869efa6043c0</uuid>
Nov 14 16:06:41 user nova-compute[75097]:   <name>instance-00000011</name>
Nov 14 16:06:41 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:06:41 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:06:41 user nova-compute[75097]:   <metadata>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:41 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:06:41 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherA-server-262853361</nova:name>
Nov 14 16:06:41 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:06:39</nova:creationTime>
Nov 14 16:06:41 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:06:41 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:41 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:06:41 user nova-compute[75097]:       <nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:user uuid="e8e4dbd7176043dc87e7a41a87e60098">tempest-ServerActionsTestOtherA-715795194-project-member</nova:user>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:project uuid="144c5ef426074ddca799c0f312162932">tempest-ServerActionsTestOtherA-715795194</nova:project>
Nov 14 16:06:41 user nova-compute[75097]:       </nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:41 user nova-compute[75097]:       <nova:ports>
Nov 14 16:06:41 user nova-compute[75097]:         <nova:port uuid="942f59ad-3b4f-4545-ab74-de84dbf0e786">
Nov 14 16:06:41 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 16:06:41 user nova-compute[75097]:         </nova:port>
Nov 14 16:06:41 user nova-compute[75097]:       </nova:ports>
Nov 14 16:06:41 user nova-compute[75097]:     </nova:instance>
Nov 14 16:06:41 user nova-compute[75097]:   </metadata>
Nov 14 16:06:41 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:06:41 user nova-compute[75097]:     <system>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name="serial">f4eb61fa-ad89-4fad-b649-869efa6043c0</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name="uuid">f4eb61fa-ad89-4fad-b649-869efa6043c0</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:06:41 user nova-compute[75097]:     </system>
Nov 14 16:06:41 user nova-compute[75097]:   </sysinfo>
Nov 14 16:06:41 user nova-compute[75097]:   <os>
Nov 14 16:06:41 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:06:41 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:06:41 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:06:41 user nova-compute[75097]:   </os>
Nov 14 16:06:41 user nova-compute[75097]:   <features>
Nov 14 16:06:41 user nova-compute[75097]:     <acpi/>
Nov 14 16:06:41 user nova-compute[75097]:     <apic/>
Nov 14 16:06:41 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:06:41 user nova-compute[75097]:   </features>
Nov 14 16:06:41 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:06:41 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:06:41 user nova-compute[75097]:   </clock>
Nov 14 16:06:41 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:06:41 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:06:41 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:06:41 user nova-compute[75097]:   </cpu>
Nov 14 16:06:41 user nova-compute[75097]:   <devices>
Nov 14 16:06:41 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:06:41 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:06:41 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk"/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:06:41 user nova-compute[75097]:     </disk>
Nov 14 16:06:41 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:06:41 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:06:41 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:06:41 user nova-compute[75097]:       <serial>13e87877-2380-48a3-894d-58955eca5e67</serial>
Nov 14 16:06:41 user nova-compute[75097]:     </disk>
Nov 14 16:06:41 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:06:41 user nova-compute[75097]:       <mac address="fa:16:3e:a8:3f:85"/>
Nov 14 16:06:41 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:06:41 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev="tap942f59ad-3b"/>
Nov 14 16:06:41 user nova-compute[75097]:     </interface>
Nov 14 16:06:41 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:06:41 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/console.log" append="off"/>
Nov 14 16:06:41 user nova-compute[75097]:     </serial>
Nov 14 16:06:41 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:06:41 user nova-compute[75097]:     <video>
Nov 14 16:06:41 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:06:41 user nova-compute[75097]:     </video>
Nov 14 16:06:41 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:06:41 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:06:41 user nova-compute[75097]:     </rng>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:06:41 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:06:41 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:06:41 user nova-compute[75097]:     </memballoon>
Nov 14 16:06:41 user nova-compute[75097]:   </devices>
Nov 14 16:06:41 user nova-compute[75097]: </domain>
Nov 14 16:06:41 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1600934682',display_name='tempest-ServerActionsTestOtherA-server-262853361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1600934682',id=17,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSXJJUSODFI4cAb2k9NEktgfAYWMb0LkasDxu0ebPJq3WK3O4/dIQAma25q1DmS8B+ZzHbyX8Dm37qKQvD1tndswkqegWiKxemgPlClz7T4zTEGctOcBZhCgUAj4Hjbg==',key_name='tempest-keypair-1661349674',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:04:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-ulnvtc04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=f4eb61fa-ad89-4fad-b649-869efa6043c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG os_vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34609748-5f36-56c4-96f5-eeb163b0ec56', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap942f59ad-3b, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap942f59ad-3b, col_values=(('qos', UUID('525738b4-9275-43de-a2d2-c3bf598978e5')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap942f59ad-3b, col_values=(('external_ids', {'iface-id': '942f59ad-3b4f-4545-ab74-de84dbf0e786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:3f:85', 'vm-uuid': 'f4eb61fa-ad89-4fad-b649-869efa6043c0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: INFO os_vif [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b')
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-deleted-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:41 user nova-compute[75097]: INFO nova.compute.manager [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Neutron deleted interface feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7; detaching it from the instance and deleting it from the info cache
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No VIF found with MAC fa:16:3e:a8:3f:85, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquired lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.objects.instance [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Lazy-loading 'system_metadata' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.objects.instance [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Lazy-loading 'flavor' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.objects.base [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Object Instance<9f739f81-f9a3-4b90-a99d-12bd82c3602d> lazy-loaded attributes: system_metadata,flavor {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Converting VIF {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface> {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 14 16:06:41 user nova-compute[75097]:   <name>instance-0000000f</name>
Nov 14 16:06:41 user nova-compute[75097]:   <uuid>9f739f81-f9a3-4b90-a99d-12bd82c3602d</uuid>
Nov 14 16:06:41 user nova-compute[75097]:   <metadata>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:41 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:06:40</nova:creationTime>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:06:41 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:ports>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:06:41 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:06:41 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:ports>
Nov 14 16:06:41 user nova-compute[75097]: </nova:instance>
Nov 14 16:06:41 user nova-compute[75097]:   </metadata>
Nov 14 16:06:41 user nova-compute[75097]:   <memory unit='KiB'>524288</memory>
Nov 14 16:06:41 user nova-compute[75097]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 16:06:41 user nova-compute[75097]:   <vcpu placement='static'>1</vcpu>
Nov 14 16:06:41 user nova-compute[75097]:   <resource>
Nov 14 16:06:41 user nova-compute[75097]:     <partition>/machine</partition>
Nov 14 16:06:41 user nova-compute[75097]:   </resource>
Nov 14 16:06:41 user nova-compute[75097]:   <sysinfo type='smbios'>
Nov 14 16:06:41 user nova-compute[75097]:     <system>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='version'>0.0.0</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='serial'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='uuid'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='family'>Virtual Machine</entry>
Nov 14 16:06:41 user nova-compute[75097]:     </system>
Nov 14 16:06:41 user nova-compute[75097]:   </sysinfo>
Nov 14 16:06:41 user nova-compute[75097]:   <os>
Nov 14 16:06:41 user nova-compute[75097]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 16:06:41 user nova-compute[75097]:     <boot dev='hd'/>
Nov 14 16:06:41 user nova-compute[75097]:     <smbios mode='sysinfo'/>
Nov 14 16:06:41 user nova-compute[75097]:   </os>
Nov 14 16:06:41 user nova-compute[75097]:   <features>
Nov 14 16:06:41 user nova-compute[75097]:     <acpi/>
Nov 14 16:06:41 user nova-compute[75097]:     <apic/>
Nov 14 16:06:41 user nova-compute[75097]:     <vmcoreinfo state='on'/>
Nov 14 16:06:41 user nova-compute[75097]:   </features>
Nov 14 16:06:41 user nova-compute[75097]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 16:06:41 user nova-compute[75097]:     <model fallback='forbid'>Nehalem</model>
Nov 14 16:06:41 user nova-compute[75097]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 16:06:41 user nova-compute[75097]:     <feature policy='require' name='vme'/>
Nov 14 16:06:41 user nova-compute[75097]:     <feature policy='require' name='x2apic'/>
Nov 14 16:06:41 user nova-compute[75097]:     <feature policy='require' name='hypervisor'/>
Nov 14 16:06:41 user nova-compute[75097]:   </cpu>
Nov 14 16:06:41 user nova-compute[75097]:   <clock offset='utc'>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name='hpet' present='no'/>
Nov 14 16:06:41 user nova-compute[75097]:   </clock>
Nov 14 16:06:41 user nova-compute[75097]:   <on_poweroff>destroy</on_poweroff>
Nov 14 16:06:41 user nova-compute[75097]:   <on_reboot>restart</on_reboot>
Nov 14 16:06:41 user nova-compute[75097]:   <on_crash>destroy</on_crash>
Nov 14 16:06:41 user nova-compute[75097]:   <devices>
Nov 14 16:06:41 user nova-compute[75097]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 16:06:41 user nova-compute[75097]:     <disk type='file' device='disk'>
Nov 14 16:06:41 user nova-compute[75097]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 16:06:41 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk' index='2'/>
Nov 14 16:06:41 user nova-compute[75097]:       <backingStore type='file' index='3'>
Nov 14 16:06:41 user nova-compute[75097]:         <format type='raw'/>
Nov 14 16:06:41 user nova-compute[75097]:         <source file='/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee'/>
Nov 14 16:06:41 user nova-compute[75097]:         <backingStore/>
Nov 14 16:06:41 user nova-compute[75097]:       </backingStore>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev='vda' bus='virtio'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='virtio-disk0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </disk>
Nov 14 16:06:41 user nova-compute[75097]:     <disk type='file' device='cdrom'>
Nov 14 16:06:41 user nova-compute[75097]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 16:06:41 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config' index='1'/>
Nov 14 16:06:41 user nova-compute[75097]:       <backingStore/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev='hda' bus='ide'/>
Nov 14 16:06:41 user nova-compute[75097]:       <readonly/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='ide0-0-0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </disk>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type='usb' index='0' model='none'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='usb'/>
Nov 14 16:06:41 user nova-compute[75097]:     </controller>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='pci.0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </controller>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type='ide' index='0'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='ide'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 16:06:41 user nova-compute[75097]:     </controller>
Nov 14 16:06:41 user nova-compute[75097]:     <interface type='ethernet'>
Nov 14 16:06:41 user nova-compute[75097]:       <mac address='fa:16:3e:6b:82:67'/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev='tap0297ecfb-74'/>
Nov 14 16:06:41 user nova-compute[75097]:       <model type='virtio'/>
Nov 14 16:06:41 user nova-compute[75097]:       <mtu size='1442'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='net0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </interface>
Nov 14 16:06:41 user nova-compute[75097]:     <serial type='pty'>
Nov 14 16:06:41 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:41 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:41 user nova-compute[75097]:       <target type='isa-serial' port='0'>
Nov 14 16:06:41 user nova-compute[75097]:         <model name='isa-serial'/>
Nov 14 16:06:41 user nova-compute[75097]:       </target>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </serial>
Nov 14 16:06:41 user nova-compute[75097]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 16:06:41 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:41 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:41 user nova-compute[75097]:       <target type='serial' port='0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </console>
Nov 14 16:06:41 user nova-compute[75097]:     <input type='mouse' bus='ps2'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='input0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </input>
Nov 14 16:06:41 user nova-compute[75097]:     <input type='keyboard' bus='ps2'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='input1'/>
Nov 14 16:06:41 user nova-compute[75097]:     </input>
Nov 14 16:06:41 user nova-compute[75097]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 14 16:06:41 user nova-compute[75097]:       <listen type='address' address='0.0.0.0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </graphics>
Nov 14 16:06:41 user nova-compute[75097]:     <audio id='1' type='none'/>
Nov 14 16:06:41 user nova-compute[75097]:     <video>
Nov 14 16:06:41 user nova-compute[75097]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='video0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </video>
Nov 14 16:06:41 user nova-compute[75097]:     <memballoon model='virtio'>
Nov 14 16:06:41 user nova-compute[75097]:       <stats period='10'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='balloon0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </memballoon>
Nov 14 16:06:41 user nova-compute[75097]:     <rng model='virtio'>
Nov 14 16:06:41 user nova-compute[75097]:       <backend model='random'>/dev/urandom</backend>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='rng0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </rng>
Nov 14 16:06:41 user nova-compute[75097]:   </devices>
Nov 14 16:06:41 user nova-compute[75097]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 16:06:41 user nova-compute[75097]:     <label>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</label>
Nov 14 16:06:41 user nova-compute[75097]:     <imagelabel>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</imagelabel>
Nov 14 16:06:41 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:41 user nova-compute[75097]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 16:06:41 user nova-compute[75097]:     <label>+64055:+108</label>
Nov 14 16:06:41 user nova-compute[75097]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 16:06:41 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:41 user nova-compute[75097]: </domain>
Nov 14 16:06:41 user nova-compute[75097]:  {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface> {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a9:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3ae8b-aa"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 14 16:06:41 user nova-compute[75097]:   <name>instance-0000000f</name>
Nov 14 16:06:41 user nova-compute[75097]:   <uuid>9f739f81-f9a3-4b90-a99d-12bd82c3602d</uuid>
Nov 14 16:06:41 user nova-compute[75097]:   <metadata>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:41 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:06:40</nova:creationTime>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:06:41 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:ports>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:06:41 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:06:41 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:ports>
Nov 14 16:06:41 user nova-compute[75097]: </nova:instance>
Nov 14 16:06:41 user nova-compute[75097]:   </metadata>
Nov 14 16:06:41 user nova-compute[75097]:   <memory unit='KiB'>524288</memory>
Nov 14 16:06:41 user nova-compute[75097]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 16:06:41 user nova-compute[75097]:   <vcpu placement='static'>1</vcpu>
Nov 14 16:06:41 user nova-compute[75097]:   <resource>
Nov 14 16:06:41 user nova-compute[75097]:     <partition>/machine</partition>
Nov 14 16:06:41 user nova-compute[75097]:   </resource>
Nov 14 16:06:41 user nova-compute[75097]:   <sysinfo type='smbios'>
Nov 14 16:06:41 user nova-compute[75097]:     <system>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='version'>0.0.0</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='serial'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='uuid'>9f739f81-f9a3-4b90-a99d-12bd82c3602d</entry>
Nov 14 16:06:41 user nova-compute[75097]:       <entry name='family'>Virtual Machine</entry>
Nov 14 16:06:41 user nova-compute[75097]:     </system>
Nov 14 16:06:41 user nova-compute[75097]:   </sysinfo>
Nov 14 16:06:41 user nova-compute[75097]:   <os>
Nov 14 16:06:41 user nova-compute[75097]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 16:06:41 user nova-compute[75097]:     <boot dev='hd'/>
Nov 14 16:06:41 user nova-compute[75097]:     <smbios mode='sysinfo'/>
Nov 14 16:06:41 user nova-compute[75097]:   </os>
Nov 14 16:06:41 user nova-compute[75097]:   <features>
Nov 14 16:06:41 user nova-compute[75097]:     <acpi/>
Nov 14 16:06:41 user nova-compute[75097]:     <apic/>
Nov 14 16:06:41 user nova-compute[75097]:     <vmcoreinfo state='on'/>
Nov 14 16:06:41 user nova-compute[75097]:   </features>
Nov 14 16:06:41 user nova-compute[75097]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 16:06:41 user nova-compute[75097]:     <model fallback='forbid'>Nehalem</model>
Nov 14 16:06:41 user nova-compute[75097]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 16:06:41 user nova-compute[75097]:     <feature policy='require' name='vme'/>
Nov 14 16:06:41 user nova-compute[75097]:     <feature policy='require' name='x2apic'/>
Nov 14 16:06:41 user nova-compute[75097]:     <feature policy='require' name='hypervisor'/>
Nov 14 16:06:41 user nova-compute[75097]:   </cpu>
Nov 14 16:06:41 user nova-compute[75097]:   <clock offset='utc'>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 16:06:41 user nova-compute[75097]:     <timer name='hpet' present='no'/>
Nov 14 16:06:41 user nova-compute[75097]:   </clock>
Nov 14 16:06:41 user nova-compute[75097]:   <on_poweroff>destroy</on_poweroff>
Nov 14 16:06:41 user nova-compute[75097]:   <on_reboot>restart</on_reboot>
Nov 14 16:06:41 user nova-compute[75097]:   <on_crash>destroy</on_crash>
Nov 14 16:06:41 user nova-compute[75097]:   <devices>
Nov 14 16:06:41 user nova-compute[75097]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 16:06:41 user nova-compute[75097]:     <disk type='file' device='disk'>
Nov 14 16:06:41 user nova-compute[75097]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 16:06:41 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk' index='2'/>
Nov 14 16:06:41 user nova-compute[75097]:       <backingStore type='file' index='3'>
Nov 14 16:06:41 user nova-compute[75097]:         <format type='raw'/>
Nov 14 16:06:41 user nova-compute[75097]:         <source file='/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee'/>
Nov 14 16:06:41 user nova-compute[75097]:         <backingStore/>
Nov 14 16:06:41 user nova-compute[75097]:       </backingStore>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev='vda' bus='virtio'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='virtio-disk0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </disk>
Nov 14 16:06:41 user nova-compute[75097]:     <disk type='file' device='cdrom'>
Nov 14 16:06:41 user nova-compute[75097]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 16:06:41 user nova-compute[75097]:       <source file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/disk.config' index='1'/>
Nov 14 16:06:41 user nova-compute[75097]:       <backingStore/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev='hda' bus='ide'/>
Nov 14 16:06:41 user nova-compute[75097]:       <readonly/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='ide0-0-0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </disk>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type='usb' index='0' model='none'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='usb'/>
Nov 14 16:06:41 user nova-compute[75097]:     </controller>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='pci.0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </controller>
Nov 14 16:06:41 user nova-compute[75097]:     <controller type='ide' index='0'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='ide'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 16:06:41 user nova-compute[75097]:     </controller>
Nov 14 16:06:41 user nova-compute[75097]:     <interface type='ethernet'>
Nov 14 16:06:41 user nova-compute[75097]:       <mac address='fa:16:3e:6b:82:67'/>
Nov 14 16:06:41 user nova-compute[75097]:       <target dev='tap0297ecfb-74'/>
Nov 14 16:06:41 user nova-compute[75097]:       <model type='virtio'/>
Nov 14 16:06:41 user nova-compute[75097]:       <mtu size='1442'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='net0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </interface>
Nov 14 16:06:41 user nova-compute[75097]:     <serial type='pty'>
Nov 14 16:06:41 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:41 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:41 user nova-compute[75097]:       <target type='isa-serial' port='0'>
Nov 14 16:06:41 user nova-compute[75097]:         <model name='isa-serial'/>
Nov 14 16:06:41 user nova-compute[75097]:       </target>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </serial>
Nov 14 16:06:41 user nova-compute[75097]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 16:06:41 user nova-compute[75097]:       <source path='/dev/pts/7'/>
Nov 14 16:06:41 user nova-compute[75097]:       <log file='/opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d/console.log' append='off'/>
Nov 14 16:06:41 user nova-compute[75097]:       <target type='serial' port='0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='serial0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </console>
Nov 14 16:06:41 user nova-compute[75097]:     <input type='mouse' bus='ps2'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='input0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </input>
Nov 14 16:06:41 user nova-compute[75097]:     <input type='keyboard' bus='ps2'>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='input1'/>
Nov 14 16:06:41 user nova-compute[75097]:     </input>
Nov 14 16:06:41 user nova-compute[75097]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 14 16:06:41 user nova-compute[75097]:       <listen type='address' address='0.0.0.0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </graphics>
Nov 14 16:06:41 user nova-compute[75097]:     <audio id='1' type='none'/>
Nov 14 16:06:41 user nova-compute[75097]:     <video>
Nov 14 16:06:41 user nova-compute[75097]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='video0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </video>
Nov 14 16:06:41 user nova-compute[75097]:     <memballoon model='virtio'>
Nov 14 16:06:41 user nova-compute[75097]:       <stats period='10'/>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='balloon0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </memballoon>
Nov 14 16:06:41 user nova-compute[75097]:     <rng model='virtio'>
Nov 14 16:06:41 user nova-compute[75097]:       <backend model='random'>/dev/urandom</backend>
Nov 14 16:06:41 user nova-compute[75097]:       <alias name='rng0'/>
Nov 14 16:06:41 user nova-compute[75097]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 16:06:41 user nova-compute[75097]:     </rng>
Nov 14 16:06:41 user nova-compute[75097]:   </devices>
Nov 14 16:06:41 user nova-compute[75097]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 16:06:41 user nova-compute[75097]:     <label>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</label>
Nov 14 16:06:41 user nova-compute[75097]:     <imagelabel>libvirt-9f739f81-f9a3-4b90-a99d-12bd82c3602d</imagelabel>
Nov 14 16:06:41 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:41 user nova-compute[75097]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 16:06:41 user nova-compute[75097]:     <label>+64055:+108</label>
Nov 14 16:06:41 user nova-compute[75097]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 16:06:41 user nova-compute[75097]:   </seclabel>
Nov 14 16:06:41 user nova-compute[75097]: </domain>
Nov 14 16:06:41 user nova-compute[75097]:  {{(pid=75097) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 16:06:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Detaching interface fa:16:3e:f5:a9:d6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapfeb3ae8b-aa' not found.
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Converting VIF {"id": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "address": "fa:16:3e:f5:a9:d6", "network": {"id": "9313b883-28e2-44a4-98e1-5b5860470adb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1554105273", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3ae8b-aa", "ovs_interfaceid": "feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.os_vif_util [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG os_vif [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeb3ae8b-aa, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:06:41 user nova-compute[75097]: INFO os_vif [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a9:d6,bridge_name='br-int',has_traffic_filtering=True,id=feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7,network=Network(9313b883-28e2-44a4-98e1-5b5860470adb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3ae8b-aa')
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [req-eb5ad1fc-095d-43d0-9c29-bb27417b0936 req-6ada25ec-f059-40a6-b44c-b164f8731131 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:41 user nova-compute[75097]:   <nova:package version="0.0.0"/>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:name>tempest-device-tagging-server-392563560</nova:name>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:creationTime>2023-11-14 16:06:41</nova:creationTime>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:flavor name="m1.tiny">
Nov 14 16:06:41 user nova-compute[75097]:     <nova:memory>512</nova:memory>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:disk>1</nova:disk>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:swap>0</nova:swap>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:flavor>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:user uuid="d5f35d919f944a3984a538daa57fef3c">tempest-TaggedAttachmentsTest-2124214641-project-member</nova:user>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:project uuid="0d7b3f9a7c5942a395e55f73157a7dc1">tempest-TaggedAttachmentsTest-2124214641</nova:project>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:owner>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:41 user nova-compute[75097]:   <nova:ports>
Nov 14 16:06:41 user nova-compute[75097]:     <nova:port uuid="0297ecfb-7446-4658-8ff2-de675bb1d52d">
Nov 14 16:06:41 user nova-compute[75097]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:06:41 user nova-compute[75097]:     </nova:port>
Nov 14 16:06:41 user nova-compute[75097]:   </nova:ports>
Nov 14 16:06:41 user nova-compute[75097]: </nova:instance>
Nov 14 16:06:41 user nova-compute[75097]:  {{(pid=75097) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [{"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Releasing lock "refresh_cache-9f739f81-f9a3-4b90-a99d-12bd82c3602d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-858dc635-280b-469a-aba6-8066e8fcf273 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "interface-9f739f81-f9a3-4b90-a99d-12bd82c3602d-feb3ae8b-aa49-409e-b0f0-6c8eda2b76a7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.456s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Starting finish_revert_migration {{(pid=75097) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start _get_guest_xml network_info=[{"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0eaff6ee-9806-4f4b-9492-ccc8328a63e0', 'attached_at': '2023-11-14T16:06:42.000000', 'detached_at': '', 'volume_id': '96c2fdb9-1a51-491b-9e80-42da8796edfc', 'serial': '96c2fdb9-1a51-491b-9e80-42da8796edfc'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'b9417af0-03e3-44f9-85d7-986cf272f7ed', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:06:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:06:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:06:42 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:42 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:06:42 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1363d1dd-8765-4754-85b1-13cf9229c9b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:06:42 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7bd581-7441-4e4d-a5f8-3fd4b5d58383]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc] added
Nov 14 16:06:42 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d75a11e-f8e6-4d1a-a2bb-a3ad8a3b2c98]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0dbda-ae4a-4177-9077-49886a478858]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDRdhbci {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tDRdhbci" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[47461d5f-6b4a-4a1d-9297-85105a05c586]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tDRdhbci'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf6521-3cf0-47f5-8c12-65754e68c37e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a2c191-4914-48ac-807f-45d67db1b345]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c28c87f-25b9-4838-bb16-66fe2a8c393b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]
Nov 14 16:06:42 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.
Nov 14 16:06:42 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50353181-c749-496d-a900-b0b6be2d60fb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d13818-1546-4d84-8a91-00ca8cbc329d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:42 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:06:42 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:06:42 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a7ec19-5cd1-4171-aa5d-a56586e6ba0f]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:43 user nova-compute[75097]: INFO nova.compute.manager [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Terminating instance
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:43 user nova-compute[75097]: WARNING nova.compute.manager [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:43 user nova-compute[75097]: WARNING nova.compute.manager [req-a91e10c1-96f0-4dc6-9e65-66c491567306 req-fbe3b9b1-e2df-48e2-929f-29949888cab5 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc17e1bd-2e76-4ca0-9bc6-01e43ace6bde req-6c758b06-c64d-4428-b312-dd80f9f37a3c service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-vif-unplugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc17e1bd-2e76-4ca0-9bc6-01e43ace6bde req-6c758b06-c64d-4428-b312-dd80f9f37a3c service nova] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc17e1bd-2e76-4ca0-9bc6-01e43ace6bde req-6c758b06-c64d-4428-b312-dd80f9f37a3c service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc17e1bd-2e76-4ca0-9bc6-01e43ace6bde req-6c758b06-c64d-4428-b312-dd80f9f37a3c service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc17e1bd-2e76-4ca0-9bc6-01e43ace6bde req-6c758b06-c64d-4428-b312-dd80f9f37a3c service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] No waiting events found dispatching network-vif-unplugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc17e1bd-2e76-4ca0-9bc6-01e43ace6bde req-6c758b06-c64d-4428-b312-dd80f9f37a3c service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-vif-unplugged-6be39345-f45b-4a47-828b-d81f9766c60c for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26637353130386134', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353130386134', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:06:43 user nova-compute[75097]:   <uuid>0eaff6ee-9806-4f4b-9492-ccc8328a63e0</uuid>
Nov 14 16:06:43 user nova-compute[75097]:   <name>instance-00000005</name>
Nov 14 16:06:43 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:06:43 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:06:43 user nova-compute[75097]:   <metadata>
Nov 14 16:06:43 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:06:43 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:06:43 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherB-server-462759233</nova:name>
Nov 14 16:06:43 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:06:42</nova:creationTime>
Nov 14 16:06:43 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:06:43 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:06:43 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:06:43 user nova-compute[75097]:       <nova:owner>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:user uuid="257dfabc0d374fdcaf4897d360547fb5">tempest-ServerActionsTestOtherB-652208077-project-member</nova:user>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:project uuid="0301ebf075c14cee925c28d1e74b1598">tempest-ServerActionsTestOtherB-652208077</nova:project>
Nov 14 16:06:43 user nova-compute[75097]:       </nova:owner>
Nov 14 16:06:43 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:06:43 user nova-compute[75097]:       <nova:ports>
Nov 14 16:06:43 user nova-compute[75097]:         <nova:port uuid="665262a2-60e0-4453-aa2e-2e6373bc86cf">
Nov 14 16:06:43 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:06:43 user nova-compute[75097]:         </nova:port>
Nov 14 16:06:43 user nova-compute[75097]:       </nova:ports>
Nov 14 16:06:43 user nova-compute[75097]:     </nova:instance>
Nov 14 16:06:43 user nova-compute[75097]:   </metadata>
Nov 14 16:06:43 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:06:43 user nova-compute[75097]:     <system>
Nov 14 16:06:43 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:06:43 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:06:43 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:06:43 user nova-compute[75097]:       <entry name="serial">0eaff6ee-9806-4f4b-9492-ccc8328a63e0</entry>
Nov 14 16:06:43 user nova-compute[75097]:       <entry name="uuid">0eaff6ee-9806-4f4b-9492-ccc8328a63e0</entry>
Nov 14 16:06:43 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:06:43 user nova-compute[75097]:     </system>
Nov 14 16:06:43 user nova-compute[75097]:   </sysinfo>
Nov 14 16:06:43 user nova-compute[75097]:   <os>
Nov 14 16:06:43 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:06:43 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:06:43 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:06:43 user nova-compute[75097]:   </os>
Nov 14 16:06:43 user nova-compute[75097]:   <features>
Nov 14 16:06:43 user nova-compute[75097]:     <acpi/>
Nov 14 16:06:43 user nova-compute[75097]:     <apic/>
Nov 14 16:06:43 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:06:43 user nova-compute[75097]:   </features>
Nov 14 16:06:43 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:06:43 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:06:43 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:06:43 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:06:43 user nova-compute[75097]:   </clock>
Nov 14 16:06:43 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:06:43 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:06:43 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:06:43 user nova-compute[75097]:   </cpu>
Nov 14 16:06:43 user nova-compute[75097]:   <devices>
Nov 14 16:06:43 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:06:43 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:06:43 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk"/>
Nov 14 16:06:43 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:06:43 user nova-compute[75097]:     </disk>
Nov 14 16:06:43 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:06:43 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:06:43 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:06:43 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:06:43 user nova-compute[75097]:       <serial>96c2fdb9-1a51-491b-9e80-42da8796edfc</serial>
Nov 14 16:06:43 user nova-compute[75097]:     </disk>
Nov 14 16:06:43 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:06:43 user nova-compute[75097]:       <mac address="fa:16:3e:37:e9:7c"/>
Nov 14 16:06:43 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:06:43 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:06:43 user nova-compute[75097]:       <target dev="tap665262a2-60"/>
Nov 14 16:06:43 user nova-compute[75097]:     </interface>
Nov 14 16:06:43 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:06:43 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/console.log" append="off"/>
Nov 14 16:06:43 user nova-compute[75097]:     </serial>
Nov 14 16:06:43 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:06:43 user nova-compute[75097]:     <video>
Nov 14 16:06:43 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:06:43 user nova-compute[75097]:     </video>
Nov 14 16:06:43 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:06:43 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:06:43 user nova-compute[75097]:     </rng>
Nov 14 16:06:43 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:06:43 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:06:43 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:06:43 user nova-compute[75097]:     </memballoon>
Nov 14 16:06:43 user nova-compute[75097]:   </devices>
Nov 14 16:06:43 user nova-compute[75097]: </domain>
Nov 14 16:06:43 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG os_vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2776eec1-7aab-5007-8038-4a01b095fe57', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap665262a2-60, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap665262a2-60, col_values=(('qos', UUID('708ba44d-cdfe-4110-a1ad-09c29342627f')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap665262a2-60, col_values=(('external_ids', {'iface-id': '665262a2-60e0-4453-aa2e-2e6373bc86cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:e9:7c', 'vm-uuid': '0eaff6ee-9806-4f4b-9492-ccc8328a63e0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:43 user nova-compute[75097]: INFO os_vif [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60')
Nov 14 16:06:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Instance destroyed successfully.
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.objects.instance [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lazy-loading 'resources' on Instance uuid 34098dea-702d-454d-af5e-35b51cac9bbf {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1810072340',display_name='tempest-VolumesAdminNegativeTest-server-1810072340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1810072340',id=7,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD45p5xvf9gglXsXFfkYqYoBgeAXZ/5aYbaaY6ufZuDpHVcq1WMrs50N9/sUEF6kjGY/nYlQwsooi3Yi3kyBARNoXUP9PEJwyCYzaQmiGixTEfrB2r2BmhGe5MHf82Cg+g==',key_name='tempest-keypair-180991964',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1f76214f6904b62b3b8987610bc22c5',ramdisk_id='',reservation_id='r-tu0o8sum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1445801438',owner_user_name='tempest-VolumesAdminNegativeTest-1445801438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='403e6a373c874a42b09067107b75355e',uuid=34098dea-702d-454d-af5e-35b51cac9bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converting VIF {"id": "6be39345-f45b-4a47-828b-d81f9766c60c", "address": "fa:16:3e:89:53:94", "network": {"id": "429f4d1f-6017-4f20-a64e-122eb4c621d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1784331061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1f76214f6904b62b3b8987610bc22c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6be39345-f4", "ovs_interfaceid": "6be39345-f45b-4a47-828b-d81f9766c60c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG os_vif [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6be39345-f4, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bee024bf-adcf-4597-9a91-0cec59dea21e) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:44 user nova-compute[75097]: INFO os_vif [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:53:94,bridge_name='br-int',has_traffic_filtering=True,id=6be39345-f45b-4a47-828b-d81f9766c60c,network=Network(429f4d1f-6017-4f20-a64e-122eb4c621d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6be39345-f4')
Nov 14 16:06:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Deleting instance files /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf_del
Nov 14 16:06:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Deletion of /opt/stack/data/nova/instances/34098dea-702d-454d-af5e-35b51cac9bbf_del complete
Nov 14 16:06:44 user nova-compute[75097]: INFO nova.compute.manager [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 14 16:06:44 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:06:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance spawned successfully.
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:45 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Took 0.91 seconds to deallocate network for instance.
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75097) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f1218a74-48f2-4d31-9d5a-dc3619794014 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.030s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] Acquiring lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] Lock "34098dea-702d-454d-af5e-35b51cac9bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] No waiting events found dispatching network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:45 user nova-compute[75097]: WARNING nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received unexpected event network-vif-plugged-6be39345-f45b-4a47-828b-d81f9766c60c for instance with vm_state deleted and task_state None.
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 34098dea-702d-454d-af5e-35b51cac9bbf] Received event network-vif-deleted-6be39345-f45b-4a47-828b-d81f9766c60c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:45 user nova-compute[75097]: WARNING nova.compute.manager [req-43639d79-4cf7-418c-b172-2ab0701900bc req-128cf317-703e-4554-ae51-233c39e98aaa service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state resized and task_state resize_reverting.
Nov 14 16:06:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:06:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.636s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:46 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Deleted allocations for instance 34098dea-702d-454d-af5e-35b51cac9bbf
Nov 14 16:06:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64c0a41e-1968-475a-a46d-eda5624311cc tempest-VolumesAdminNegativeTest-1445801438 tempest-VolumesAdminNegativeTest-1445801438-project-member] Lock "34098dea-702d-454d-af5e-35b51cac9bbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.930s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:06:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance running successfully.
Nov 14 16:06:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] finish_revert_migration finished successfully. {{(pid=75097) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 16:06:47 user nova-compute[75097]: INFO nova.compute.manager [None req-3444f91f-2bdf-4f0e-870e-5c15e052e323 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance to original state: 'active'
Nov 14 16:06:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-af3898b3-dea9-4668-8fd2-ca4c3dce6859 req-d0bea6bc-05ac-48e0-aef7-35b5870d64fd service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:06:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-af3898b3-dea9-4668-8fd2-ca4c3dce6859 req-d0bea6bc-05ac-48e0-aef7-35b5870d64fd service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:06:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-af3898b3-dea9-4668-8fd2-ca4c3dce6859 req-d0bea6bc-05ac-48e0-aef7-35b5870d64fd service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:06:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-af3898b3-dea9-4668-8fd2-ca4c3dce6859 req-d0bea6bc-05ac-48e0-aef7-35b5870d64fd service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:06:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-af3898b3-dea9-4668-8fd2-ca4c3dce6859 req-d0bea6bc-05ac-48e0-aef7-35b5870d64fd service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:06:47 user nova-compute[75097]: WARNING nova.compute.manager [req-af3898b3-dea9-4668-8fd2-ca4c3dce6859 req-d0bea6bc-05ac-48e0-aef7-35b5870d64fd service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state None.
Nov 14 16:06:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:06:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "b524df86-e1ec-4255-ba03-e8a314560af9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "17946bc0-ba29-42a0-8993-74699b98d836" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "b524df86-e1ec-4255-ba03-e8a314560af9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "17946bc0-ba29-42a0-8993-74699b98d836" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:11 user nova-compute[75097]: INFO nova.compute.manager [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Terminating instance
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-033ea96c-2488-41de-878a-9ff999a7ff6d req-bfdd1128-2534-4eaf-8d22-6eec95140c5c service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-unplugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-033ea96c-2488-41de-878a-9ff999a7ff6d req-bfdd1128-2534-4eaf-8d22-6eec95140c5c service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-033ea96c-2488-41de-878a-9ff999a7ff6d req-bfdd1128-2534-4eaf-8d22-6eec95140c5c service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-033ea96c-2488-41de-878a-9ff999a7ff6d req-bfdd1128-2534-4eaf-8d22-6eec95140c5c service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-033ea96c-2488-41de-878a-9ff999a7ff6d req-bfdd1128-2534-4eaf-8d22-6eec95140c5c service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-unplugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-033ea96c-2488-41de-878a-9ff999a7ff6d req-bfdd1128-2534-4eaf-8d22-6eec95140c5c service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-unplugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Instance destroyed successfully.
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.objects.instance [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lazy-loading 'resources' on Instance uuid 9f739f81-f9a3-4b90-a99d-12bd82c3602d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:03:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-392563560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-392563560',id=15,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR3fxjNDbbKiEja+/J6Ukc5LOe3mjJB9XzkBJ/MQ3zcEmqX4xovZkRQkW2fcyxjnwx6fXi4tq6vokXIAAxtShV/DWn0k4RRq3eaG5VgPaWRWr+sI53huEwQDu7XqbItSQ==',key_name='tempest-keypair-1523667360',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:03:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7b3f9a7c5942a395e55f73157a7dc1',ramdisk_id='',reservation_id='r-0ti53os3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2124214641',owner_user_name='tempest-TaggedAttachmentsTest-2124214641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5f35d919f944a3984a538daa57fef3c',uuid=9f739f81-f9a3-4b90-a99d-12bd82c3602d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converting VIF {"id": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "address": "fa:16:3e:6b:82:67", "network": {"id": "576d11ae-846f-4290-abcd-d30e6b9f5bec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1980582709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7b3f9a7c5942a395e55f73157a7dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0297ecfb-74", "ovs_interfaceid": "0297ecfb-7446-4658-8ff2-de675bb1d52d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG os_vif [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0297ecfb-74, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e835a3e5-7eb2-40fe-9b78-f344264b8482) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:07:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:11 user nova-compute[75097]: INFO os_vif [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:82:67,bridge_name='br-int',has_traffic_filtering=True,id=0297ecfb-7446-4658-8ff2-de675bb1d52d,network=Network(576d11ae-846f-4290-abcd-d30e6b9f5bec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0297ecfb-74')
Nov 14 16:07:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Deleting instance files /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d_del
Nov 14 16:07:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Deletion of /opt/stack/data/nova/instances/9f739f81-f9a3-4b90-a99d-12bd82c3602d_del complete
Nov 14 16:07:12 user nova-compute[75097]: INFO nova.compute.manager [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 16:07:12 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:12 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Took 0.80 seconds to deallocate network for instance.
Nov 14 16:07:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-9e281a03-f0bb-419d-9a10-93afe1155ac3 req-faf26e6c-6518-4721-a999-788ac59e1b91 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-deleted-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:12 user nova-compute[75097]: INFO nova.compute.manager [req-9e281a03-f0bb-419d-9a10-93afe1155ac3 req-faf26e6c-6518-4721-a999-788ac59e1b91 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Neutron deleted interface 0297ecfb-7446-4658-8ff2-de675bb1d52d; detaching it from the instance and deleting it from the info cache
Nov 14 16:07:12 user nova-compute[75097]: DEBUG nova.network.neutron [req-9e281a03-f0bb-419d-9a10-93afe1155ac3 req-faf26e6c-6518-4721-a999-788ac59e1b91 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-9e281a03-f0bb-419d-9a10-93afe1155ac3 req-faf26e6c-6518-4721-a999-788ac59e1b91 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Detach interface failed, port_id=0297ecfb-7446-4658-8ff2-de675bb1d52d, reason: Instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Deleted allocations for instance 9f739f81-f9a3-4b90-a99d-12bd82c3602d
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e20bee5f-8c8b-4c1a-b80e-dc32bb41a703 tempest-TaggedAttachmentsTest-2124214641 tempest-TaggedAttachmentsTest-2124214641-project-member] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:13 user nova-compute[75097]: WARNING nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state deleted and task_state None.
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:13 user nova-compute[75097]: WARNING nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state deleted and task_state None.
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:13 user nova-compute[75097]: WARNING nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state deleted and task_state None.
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-unplugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-unplugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:13 user nova-compute[75097]: WARNING nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-unplugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state deleted and task_state None.
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Acquiring lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] Lock "9f739f81-f9a3-4b90-a99d-12bd82c3602d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] No waiting events found dispatching network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:13 user nova-compute[75097]: WARNING nova.compute.manager [req-ce6ea2cd-4f3d-4de3-ad3d-a996b97bc6b4 req-1358769c-c7f0-431c-961f-99fd6c34ccf1 service nova] [instance: 9f739f81-f9a3-4b90-a99d-12bd82c3602d] Received unexpected event network-vif-plugged-0297ecfb-7446-4658-8ff2-de675bb1d52d for instance with vm_state deleted and task_state None.
Nov 14 16:07:13 user nova-compute[75097]: INFO nova.compute.manager [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Unrescuing
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:13 user nova-compute[75097]: DEBUG nova.network.neutron [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'flavor' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-0773bb6d-f219-416a-9cf8-dbee5a977602 req-e1143334-2803-4790-babe-fe7ce1fb8288 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0773bb6d-f219-416a-9cf8-dbee5a977602 req-e1143334-2803-4790-babe-fe7ce1fb8288 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0773bb6d-f219-416a-9cf8-dbee5a977602 req-e1143334-2803-4790-babe-fe7ce1fb8288 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0773bb6d-f219-416a-9cf8-dbee5a977602 req-e1143334-2803-4790-babe-fe7ce1fb8288 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-0773bb6d-f219-416a-9cf8-dbee5a977602 req-e1143334-2803-4790-babe-fe7ce1fb8288 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:14 user nova-compute[75097]: WARNING nova.compute.manager [req-0773bb6d-f219-416a-9cf8-dbee5a977602 req-e1143334-2803-4790-babe-fe7ce1fb8288 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:07:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance destroyed successfully.
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:16 user nova-compute[75097]: WARNING nova.compute.manager [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:07:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:16 user nova-compute[75097]: WARNING nova.compute.manager [req-e531204b-d3c8-4c8f-a667-fa57637cf105 req-a7fde439-1b24-4414-a89a-234479778095 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:07:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-changed-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Refreshing instance network info cache due to event network-changed-19bce176-4dc2-41e0-960d-2a4bb314862f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] Acquiring lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] Acquired lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Refreshing network info cache for port 19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updated VIF entry in instance network info cache for port 19bce176-4dc2-41e0-960d-2a4bb314862f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:07:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updating instance_info_cache with network_info: [{"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-03c8289f-db16-4543-a39f-b2601d1c7f59 req-889df003-e023-4fca-b206-3753dbdc59d9 service nova] Releasing lock "refresh_cache-343d4aa5-7639-48bd-be32-92cc8d0b57fe" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-aafa4c47-cf33-4653-a290-a43fe4b3e123 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-22c4dda3-395e-4a68-8856-4f7835ae8282 req-e5aaac84-960c-42f8-a364-abdeb6d34919 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-22c4dda3-395e-4a68-8856-4f7835ae8282 req-e5aaac84-960c-42f8-a364-abdeb6d34919 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-22c4dda3-395e-4a68-8856-4f7835ae8282 req-e5aaac84-960c-42f8-a364-abdeb6d34919 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-22c4dda3-395e-4a68-8856-4f7835ae8282 req-e5aaac84-960c-42f8-a364-abdeb6d34919 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-22c4dda3-395e-4a68-8856-4f7835ae8282 req-e5aaac84-960c-42f8-a364-abdeb6d34919 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:18 user nova-compute[75097]: WARNING nova.compute.manager [req-22c4dda3-395e-4a68-8856-4f7835ae8282 req-e5aaac84-960c-42f8-a364-abdeb6d34919 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state active and task_state None.
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG nova.objects.instance [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:19 user nova-compute[75097]: INFO nova.compute.manager [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Attaching volume 2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 to /dev/vdb
Nov 14 16:07:19 user nova-compute[75097]: DEBUG os_brick.utils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3e933f-cc6c-48a9-8b8f-79d715c755ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a1cec-987d-4a92-a011-af4b971c74c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dd7641-ea1f-48ba-a007-95047aa339a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[423a991c-c1d4-40dc-9adc-205145413b4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:07:19 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:07:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bca689-3db5-42b5-b869-c98514257c2f]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG os_brick.utils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:07:19 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updating existing volume attachment record: 57793767-20a9-444f-a4a3-99325510009a {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:07:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuOXCVwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:07:24 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:07:24 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:07:24 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[44688031-83a7-49f7-a599-43f9529b23fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:07:24 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df1db4-9d5e-44b7-b3de-0e41a6ccc350]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0] added
Nov 14 16:07:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd10c7c-091b-4f68-b2f6-2878ba709cae]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce1993-e9ad-4820-adc9-16047854c2af]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuOXCVwP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuOXCVwP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[18876525-092f-4d75-89c0-43ab9a077f0c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuOXCVwP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed64b8-74bd-402a-b3e0-5b77c7e437ea]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[62731d9a-7c0f-42e6-8a70-dc643c1bcbf8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfdec83-7cf3-43d3-85f1-a41009f22c26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260]
Nov 14 16:07:24 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260] successful.
Nov 14 16:07:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab0c41-7220-4296-b4b8-e0787a329c59]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762ccff-4bdc-4940-9f5d-50af3cdbec4e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:24 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01c10a4-66a0-41c0-8d89-c22e27bd3ee1]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuOXCVwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26438643966323437', 'path': '/dev/sdf'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643966323437', 'path': '/dev/sdf'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:07:25 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:07:25 user nova-compute[75097]:   <source dev="/dev/sdf"/>
Nov 14 16:07:25 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:07:25 user nova-compute[75097]:   <serial>2ad2f20d-465e-4c0d-8f09-32e923ea1aa0</serial>
Nov 14 16:07:25 user nova-compute[75097]: </disk>
Nov 14 16:07:25 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:07:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:07:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:07:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:a0:1e:06, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10734c7e-268f-4186-92e8-516432c1c9e5 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.023s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:07:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:07:30 user nova-compute[75097]: INFO nova.compute.claims [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Claim successful on node user
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:07:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.policy [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac22930f0fb94bfbabe013f477e056ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73525a2ed1ed475994a7d12cf23aa81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:07:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Creating image(s)
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "/opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.165s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk 1073741824" returned: 0 in 0.045s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Successfully created port: 8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Cannot resize image /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Ensure instance console log exists: /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing instance network info cache due to event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Successfully updated port: 8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquired lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-changed-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Refreshing instance network info cache due to event network-changed-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] Acquiring lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updated VIF entry in instance network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-84d6fe32-bb73-4c33-981d-efbe7e9a8619 req-927ced3f-5491-4184-805a-a358084f5460 service nova] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Updating instance_info_cache with network_info: [{"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Releasing lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Instance network_info: |[{"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] Acquired lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Refreshing network info cache for port 8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:07:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Start _get_guest_xml network_info=[{"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:07:32 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:07:32 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1061920894',display_name='tempest-AttachVolumeNegativeTest-server-1061920894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1061920894',id=21,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWQ9oscQqo5b6U7EIlTay64zVPSGqVkwOw1uPZOl032K0W/0I5lKO8YS/ghbaLsP3CtOTCBERxvXUK1JYna+R0iVFanUOUoJEvvrO4SNiQOeBaeoY9qYKjcbyjQ5hSQfw==',key_name='tempest-keypair-2002112897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-0fxtykew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=3003a213-db76-4a1d-bf0f-0f2fe8adba22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'pci_devices' on Instance uuid 3003a213-db76-4a1d-bf0f-0f2fe8adba22 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:33 user nova-compute[75097]: INFO nova.compute.manager [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Shelve offloading
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:07:33 user nova-compute[75097]:   <uuid>3003a213-db76-4a1d-bf0f-0f2fe8adba22</uuid>
Nov 14 16:07:33 user nova-compute[75097]:   <name>instance-00000015</name>
Nov 14 16:07:33 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:07:33 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:07:33 user nova-compute[75097]:   <metadata>
Nov 14 16:07:33 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:07:33 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:07:33 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1061920894</nova:name>
Nov 14 16:07:33 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:07:32</nova:creationTime>
Nov 14 16:07:33 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:07:33 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:07:33 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:07:33 user nova-compute[75097]:       <nova:owner>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:user uuid="ac22930f0fb94bfbabe013f477e056ca">tempest-AttachVolumeNegativeTest-907754384-project-member</nova:user>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:project uuid="73525a2ed1ed475994a7d12cf23aa81f">tempest-AttachVolumeNegativeTest-907754384</nova:project>
Nov 14 16:07:33 user nova-compute[75097]:       </nova:owner>
Nov 14 16:07:33 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:07:33 user nova-compute[75097]:       <nova:ports>
Nov 14 16:07:33 user nova-compute[75097]:         <nova:port uuid="8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c">
Nov 14 16:07:33 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 16:07:33 user nova-compute[75097]:         </nova:port>
Nov 14 16:07:33 user nova-compute[75097]:       </nova:ports>
Nov 14 16:07:33 user nova-compute[75097]:     </nova:instance>
Nov 14 16:07:33 user nova-compute[75097]:   </metadata>
Nov 14 16:07:33 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:07:33 user nova-compute[75097]:     <system>
Nov 14 16:07:33 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:07:33 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:07:33 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:07:33 user nova-compute[75097]:       <entry name="serial">3003a213-db76-4a1d-bf0f-0f2fe8adba22</entry>
Nov 14 16:07:33 user nova-compute[75097]:       <entry name="uuid">3003a213-db76-4a1d-bf0f-0f2fe8adba22</entry>
Nov 14 16:07:33 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:07:33 user nova-compute[75097]:     </system>
Nov 14 16:07:33 user nova-compute[75097]:   </sysinfo>
Nov 14 16:07:33 user nova-compute[75097]:   <os>
Nov 14 16:07:33 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:07:33 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:07:33 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:07:33 user nova-compute[75097]:   </os>
Nov 14 16:07:33 user nova-compute[75097]:   <features>
Nov 14 16:07:33 user nova-compute[75097]:     <acpi/>
Nov 14 16:07:33 user nova-compute[75097]:     <apic/>
Nov 14 16:07:33 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:07:33 user nova-compute[75097]:   </features>
Nov 14 16:07:33 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:07:33 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:07:33 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:07:33 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:07:33 user nova-compute[75097]:   </clock>
Nov 14 16:07:33 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:07:33 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:07:33 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:07:33 user nova-compute[75097]:   </cpu>
Nov 14 16:07:33 user nova-compute[75097]:   <devices>
Nov 14 16:07:33 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:07:33 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:07:33 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk"/>
Nov 14 16:07:33 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:07:33 user nova-compute[75097]:     </disk>
Nov 14 16:07:33 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:07:33 user nova-compute[75097]:       <mac address="fa:16:3e:11:7c:d4"/>
Nov 14 16:07:33 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:07:33 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:07:33 user nova-compute[75097]:       <target dev="tap8edf79d3-6d"/>
Nov 14 16:07:33 user nova-compute[75097]:     </interface>
Nov 14 16:07:33 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:07:33 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/console.log" append="off"/>
Nov 14 16:07:33 user nova-compute[75097]:     </serial>
Nov 14 16:07:33 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:07:33 user nova-compute[75097]:     <video>
Nov 14 16:07:33 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:07:33 user nova-compute[75097]:     </video>
Nov 14 16:07:33 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:07:33 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:07:33 user nova-compute[75097]:     </rng>
Nov 14 16:07:33 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:07:33 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:07:33 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:07:33 user nova-compute[75097]:     </memballoon>
Nov 14 16:07:33 user nova-compute[75097]:   </devices>
Nov 14 16:07:33 user nova-compute[75097]: </domain>
Nov 14 16:07:33 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1061920894',display_name='tempest-AttachVolumeNegativeTest-server-1061920894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1061920894',id=21,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWQ9oscQqo5b6U7EIlTay64zVPSGqVkwOw1uPZOl032K0W/0I5lKO8YS/ghbaLsP3CtOTCBERxvXUK1JYna+R0iVFanUOUoJEvvrO4SNiQOeBaeoY9qYKjcbyjQ5hSQfw==',key_name='tempest-keypair-2002112897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-0fxtykew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=3003a213-db76-4a1d-bf0f-0f2fe8adba22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG os_vif [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e3b991c-8306-5fe4-8234-1c1bc1a88c53', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8edf79d3-6d, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8edf79d3-6d, col_values=(('qos', UUID('ad5552ef-489f-4814-8a09-d79e610f7080')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8edf79d3-6d, col_values=(('external_ids', {'iface-id': '8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:7c:d4', 'vm-uuid': '3003a213-db76-4a1d-bf0f-0f2fe8adba22'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: INFO os_vif [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d')
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:11:7c:d4, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Updated VIF entry in instance network info cache for port 8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Updating instance_info_cache with network_info: [{"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62f93470-0c9a-4118-b55b-7c4d782ecb38 req-145ee3df-404d-4717-a100-75558722c1ee service nova] Releasing lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance destroyed successfully.
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-unplugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-unplugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:34 user nova-compute[75097]: WARNING nova.compute.manager [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-unplugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state active and task_state shelving.
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:34 user nova-compute[75097]: WARNING nova.compute.manager [req-0b601783-2c96-48bf-9108-9c057e348894 req-3e43e3aa-5e47-4b08-b8cc-10966aa2b4e0 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state active and task_state shelving.
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-90df0c77-6489-4e85-b598-6fa30a5ccd98 req-a75a77c4-9cc5-44e2-94fa-98426e699971 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-90df0c77-6489-4e85-b598-6fa30a5ccd98 req-a75a77c4-9cc5-44e2-94fa-98426e699971 service nova] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-90df0c77-6489-4e85-b598-6fa30a5ccd98 req-a75a77c4-9cc5-44e2-94fa-98426e699971 service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-90df0c77-6489-4e85-b598-6fa30a5ccd98 req-a75a77c4-9cc5-44e2-94fa-98426e699971 service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-90df0c77-6489-4e85-b598-6fa30a5ccd98 req-a75a77c4-9cc5-44e2-94fa-98426e699971 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] No waiting events found dispatching network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:34 user nova-compute[75097]: WARNING nova.compute.manager [req-90df0c77-6489-4e85-b598-6fa30a5ccd98 req-a75a77c4-9cc5-44e2-94fa-98426e699971 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received unexpected event network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c for instance with vm_state building and task_state spawning.
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance destroyed successfully.
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'resources' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-919452920',display_name='tempest-TestShelveInstance-server-919452920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-919452920',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiY2HrfDj1C2gaBtxDT6WTs6MBko57MU0MO1DoFNrMJWy9jcDKy1reHO2T4cqs0aCY1D81Sz3UfemSj0ny7Sa7kXg17a1ROT+RVHOcbF2FqDNXX6sMOfTf0sAaJ1io50Q==',key_name='tempest-TestShelveInstance-372931991',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d8fef64a574c1a8f84050f13037e65',ramdisk_id='',reservation_id='r-fb53j1rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2055532680',owner_user_name='tempest-TestShelveInstance-2055532680-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:06:03Z,user_data=None,user_id='fb8d8995adaf45e985b4b89db7aa0f1d',uuid=17946bc0-ba29-42a0-8993-74699b98d836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converting VIF {"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_vif [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbabe2fe-db, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cc872d3-b715-4695-9ec9-7e24ccc84ef7) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:36 user nova-compute[75097]: INFO os_vif [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db')
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:07:36 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cbb2ea-4f06-483f-85b6-1b149c83af7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:07:36 user nova-compute[75097]: No targets found.
Nov 14 16:07:36 user nova-compute[75097]: iSNS:
Nov 14 16:07:36 user nova-compute[75097]: No targets found.
Nov 14 16:07:36 user nova-compute[75097]: STATIC:
Nov 14 16:07:36 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:07:36 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:36 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:36 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:07:36 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:36 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:36 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:07:36 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:36 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:36 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:07:36 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:36 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:36 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:07:36 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:36 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:36 user nova-compute[75097]: FIRMWARE:
Nov 14 16:07:36 user nova-compute[75097]: No targets found.
Nov 14 16:07:36 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:07:36 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:07:36 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bdea1d-c593-4a60-9508-928fa2f41e15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e3eaa7-95f2-493f-84a5-a9b9ee08d7b6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:36 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:36 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf785ff490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ae785-57be-4bde-815e-ed532f524fe4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c21d4ae-cde4-45a5-a988-6f76029f5145]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9e9358-582a-434b-b490-8fd6113db430]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f289f885-5c80-4f02-accf-bd141feb68ca]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c668bc-e686-483e-a0c9-651ec0a35b47]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9149b58d-ebd0-4d78-b5bb-cbc363316373]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]
Nov 14 16:07:36 user nova-compute[75097]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.
Nov 14 16:07:36 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ee94b-ba70-4fde-9920-5cdc71bc45a2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] <== disconnect_volume: return (368ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:07:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Deleting instance files /opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836_del
Nov 14 16:07:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Deletion of /opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836_del complete
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing instance network info cache due to event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.network.neutron [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:07:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Instance spawned successfully.
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:37 user nova-compute[75097]: INFO nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-baacd2b5-0beb-4c7c-975b-884b0c356861 req-44257b7e-bf83-4a25-b091-f861abde92ea service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baacd2b5-0beb-4c7c-975b-884b0c356861 req-44257b7e-bf83-4a25-b091-f861abde92ea service nova] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baacd2b5-0beb-4c7c-975b-884b0c356861 req-44257b7e-bf83-4a25-b091-f861abde92ea service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baacd2b5-0beb-4c7c-975b-884b0c356861 req-44257b7e-bf83-4a25-b091-f861abde92ea service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-baacd2b5-0beb-4c7c-975b-884b0c356861 req-44257b7e-bf83-4a25-b091-f861abde92ea service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] No waiting events found dispatching network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:37 user nova-compute[75097]: WARNING nova.compute.manager [req-baacd2b5-0beb-4c7c-975b-884b0c356861 req-44257b7e-bf83-4a25-b091-f861abde92ea service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received unexpected event network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c for instance with vm_state building and task_state spawning.
Nov 14 16:07:37 user nova-compute[75097]: INFO nova.compute.manager [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Took 6.26 seconds to build instance.
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2ca0c387-d7db-49a1-b3fc-6b5049dbd945 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.429s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updated VIF entry in instance network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.network.neutron [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": null, "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f90260e1-c0ba-4c37-9ee7-90337b63c2f3 req-16b20782-9d32-4ebf-bb7f-938229f831d2 service nova] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:37 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Deleted allocations for instance 17946bc0-ba29-42a0-8993-74699b98d836
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'numa_topology' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG nova.objects.base [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Object Instance<17946bc0-ba29-42a0-8993-74699b98d836> lazy-loaded attributes: resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d0f05892-724d-4760-88f4-aa40e2f3140d tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.344s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:39 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '17946bc0-ba29-42a0-8993-74699b98d836' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '17946bc0-ba29-42a0-8993-74699b98d836' (instance-00000013)
Nov 14 16:07:40 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:07:40 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=25.36941909790039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f4eb61fa-ad89-4fad-b649-869efa6043c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 3003a213-db76-4a1d-bf0f-0f2fe8adba22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:07:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-changed-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Refreshing instance network info cache due to event network-changed-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] Acquiring lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] Acquired lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Refreshing network info cache for port 43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updated VIF entry in instance network info cache for port 43a2ed50-c777-4f1a-ae7f-f9b820c33fb5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updating instance_info_cache with network_info: [{"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-53611be4-e6c0-4284-8632-e2eae40dfcf4 req-ea097148-fd33-4084-bbdc-eec4a8ec4891 service nova] Releasing lock "refresh_cache-c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:07:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:07:43 user nova-compute[75097]: INFO nova.compute.manager [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Rebuilding instance
Nov 14 16:07:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-02baf12f-c427-4bc5-8c91-71b913d5cd4d req-2cf8f393-83ec-47e4-951c-15a6574c8831 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-unplugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-02baf12f-c427-4bc5-8c91-71b913d5cd4d req-2cf8f393-83ec-47e4-951c-15a6574c8831 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-02baf12f-c427-4bc5-8c91-71b913d5cd4d req-2cf8f393-83ec-47e4-951c-15a6574c8831 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-02baf12f-c427-4bc5-8c91-71b913d5cd4d req-2cf8f393-83ec-47e4-951c-15a6574c8831 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-02baf12f-c427-4bc5-8c91-71b913d5cd4d req-2cf8f393-83ec-47e4-951c-15a6574c8831 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-unplugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:43 user nova-compute[75097]: WARNING nova.compute.manager [req-02baf12f-c427-4bc5-8c91-71b913d5cd4d req-2cf8f393-83ec-47e4-951c-15a6574c8831 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-unplugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state active and task_state rebuilding.
Nov 14 16:07:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance destroyed successfully.
Nov 14 16:07:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance destroyed successfully.
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1053421887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1193502518',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkIvTZHy4KCWvjGUuzJP72IVTPtf+u/1pwxKhzdWAgjAFhtu7cSu8Q5VgjjvuqBIuu0k8oCSQG24jxFaMwkUeI6BwpC/rxUeyNW5Q1nvMARgKI51zUDpJhGjgzc0MkrhQ==',key_name='tempest-keypair-2065858370',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb9642780d214f218f29ba0ecc8204f3',ramdisk_id='',reservation_id='r-yc0iaadf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1509095738',owner_user_name='tempest-ServerActionsV293TestJSON-1509095738-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd73d9a3d5f3487b8fdccf2a46c3736d',uuid=c34dc8a1-71ab-491d-a915-6f8e1f4f1d31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converting VIF {"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43a2ed50-c7, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f39c8d23-2a40-4428-80c5-a85686d8440b) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:44 user nova-compute[75097]: INFO os_vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7')
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:07:44 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dca5ad8-8f27-4aac-9aff-7cfc7f81674d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:07:44 user nova-compute[75097]: No targets found.
Nov 14 16:07:44 user nova-compute[75097]: iSNS:
Nov 14 16:07:44 user nova-compute[75097]: No targets found.
Nov 14 16:07:44 user nova-compute[75097]: STATIC:
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: FIRMWARE:
Nov 14 16:07:44 user nova-compute[75097]: No targets found.
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:07:44 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:07:44 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a611b6ea-0ce6-4737-9b5e-d57f4dcae350]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41b1a38-7c0a-4939-aa2f-521f0d54d82e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafb84009d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a82cf-b0c6-4b9a-99b0-248da283e5fb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0d328c-a1d6-4077-8d5a-0367c1ef43ce]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ed7d2-300c-47db-9722-b230432d6d55]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1808e396-7a9d-4939-80a0-da32856f2d02]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_68a9e031', '/dev/disk/by-id/scsi-23030653635393734', '/dev/disk/by-id/scsi-1SCST_BIO68a9e031-00e6597487a5ef30') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba736ac4-3d6f-4971-939d-c17c137e4a18]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8fd0b3-8052-4701-9b46-39f37e04a752]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5bce9-1624-410d-ba8b-aaf21c31bdf4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]
Nov 14 16:07:44 user nova-compute[75097]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9beab1b-3f1d-4a13-9679-27d7105cdd47]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== disconnect_volume: return (356ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:07:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Deleting instance files /opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31_del
Nov 14 16:07:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Deletion of /opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31_del complete
Nov 14 16:07:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 could not be found.
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:07:44 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d66c1-2f54-48f8-8f32-7a60351e5494]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:07:44 user nova-compute[75097]: No targets found.
Nov 14 16:07:44 user nova-compute[75097]: iSNS:
Nov 14 16:07:44 user nova-compute[75097]: No targets found.
Nov 14 16:07:44 user nova-compute[75097]: STATIC:
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:07:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:07:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:07:44 user nova-compute[75097]: FIRMWARE:
Nov 14 16:07:44 user nova-compute[75097]: No targets found.
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:07:44 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:07:44 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b4eb0-9f84-492e-b734-507ce006f0dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ca2e1-70ca-47de-9cab-01b36bd40999]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:07:44 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:07:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf984abc70>, {}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Disconnecting from: [] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== disconnect_volume: return (75ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:07:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc7b2256-d4e1-467f-b693-a86239d2265b req-41271ab6-d3e9-4f9c-95c9-80a884b02bf1 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc7b2256-d4e1-467f-b693-a86239d2265b req-41271ab6-d3e9-4f9c-95c9-80a884b02bf1 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc7b2256-d4e1-467f-b693-a86239d2265b req-41271ab6-d3e9-4f9c-95c9-80a884b02bf1 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc7b2256-d4e1-467f-b693-a86239d2265b req-41271ab6-d3e9-4f9c-95c9-80a884b02bf1 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc7b2256-d4e1-467f-b693-a86239d2265b req-41271ab6-d3e9-4f9c-95c9-80a884b02bf1 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:07:45 user nova-compute[75097]: WARNING nova.compute.manager [req-fc7b2256-d4e1-467f-b693-a86239d2265b req-41271ab6-d3e9-4f9c-95c9-80a884b02bf1 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state active and task_state rebuilding.
Nov 14 16:07:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Preparing to wait for external event volume-reimaged-ce70618b-8eed-4afe-9d95-08498ea3e605 {{(pid=75097) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-460617c3-e21b-4dce-b08a-702c3d846244 req-3e663399-491e-4b04-9380-88d1b2729e3b service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event volume-reimaged-ce70618b-8eed-4afe-9d95-08498ea3e605 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-460617c3-e21b-4dce-b08a-702c3d846244 req-3e663399-491e-4b04-9380-88d1b2729e3b service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-460617c3-e21b-4dce-b08a-702c3d846244 req-3e663399-491e-4b04-9380-88d1b2729e3b service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-460617c3-e21b-4dce-b08a-702c3d846244 req-3e663399-491e-4b04-9380-88d1b2729e3b service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-460617c3-e21b-4dce-b08a-702c3d846244 req-3e663399-491e-4b04-9380-88d1b2729e3b service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Processing event volume-reimaged-ce70618b-8eed-4afe-9d95-08498ea3e605 {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:07:59 user nova-compute[75097]: INFO nova.virt.block_device [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Booting with volume ce70618b-8eed-4afe-9d95-08498ea3e605 at /dev/vda
Nov 14 16:07:59 user nova-compute[75097]: DEBUG os_brick.utils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2d0d85-20d1-49a9-add5-d1aea3247281]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fefbca-bbcc-4d11-bca7-fd94502a8fdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335a781-87f5-4055-bc9b-e9bb2d02ef86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6682cae-7948-4b0a-8d6e-60c47254369a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:07:59 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:07:59 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba408c-8617-4b66-916f-1fef8ce718f6]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG os_brick.utils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:07:59 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updating existing volume attachment record: 3838911a-9537-466a-8409-67a52e00841f {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:08:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:08:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Creating image(s)
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Ensure instance console log exists: /opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Start _get_guest_xml network_info=[{"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c34dc8a1-71ab-491d-a915-6f8e1f4f1d31', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce70618b-8eed-4afe-9d95-08498ea3e605', 'serial': 'ce70618b-8eed-4afe-9d95-08498ea3e605'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '3838911a-9537-466a-8409-67a52e00841f', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:08:04 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 16:08:04 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.objects.instance [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lazy-loading 'vcpu_model' on Instance uuid c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:04 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:04 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:04 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a15c1f-5cf4-4ea6-81da-04ed458e7080]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:08:04 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f1a7b3-5fa2-404e-86ec-ebdcf38d57b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605] added
Nov 14 16:08:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab813c7-78c6-42dd-8928-f1a3603c3d4f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e15540-41f2-470c-86ce-2c52792f2e0f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmGUJsAE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cmGUJsAE" returned: 0 in 0.032s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f42479-4eb0-46da-a060-abdf5a16eb8b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cmGUJsAE'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe85b3a-1801-41fe-a603-8f36aad8a946]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c2b48c-243d-4a44-aae5-9b49440ca47e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:04 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:04 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:04 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:04 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b863036-2101-4676-84a7-fc39b08b705c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]
Nov 14 16:08:04 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.
Nov 14 16:08:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[390f9586-1355-4925-8bf3-b7e139bc91d8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd11249-94d1-4c98-80c1-f3c16323aa19]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:05 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:05 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:05 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:05 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:05 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:05 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0036ac-a5e9-4024-8626-383ab9d6b8f5]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23030653635393734', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653635393734', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1053421887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1193502518',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkIvTZHy4KCWvjGUuzJP72IVTPtf+u/1pwxKhzdWAgjAFhtu7cSu8Q5VgjjvuqBIuu0k8oCSQG24jxFaMwkUeI6BwpC/rxUeyNW5Q1nvMARgKI51zUDpJhGjgzc0MkrhQ==',key_name='tempest-keypair-2065858370',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb9642780d214f218f29ba0ecc8204f3',ramdisk_id='',reservation_id='r-yc0iaadf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1509095738',owner_user_name='tempest-ServerActionsV293TestJSON-1509095738-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd73d9a3d5f3487b8fdccf2a46c3736d',uuid=c34dc8a1-71ab-491d-a915-6f8e1f4f1d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converting VIF {"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:08:06 user nova-compute[75097]:   <uuid>c34dc8a1-71ab-491d-a915-6f8e1f4f1d31</uuid>
Nov 14 16:08:06 user nova-compute[75097]:   <name>instance-00000014</name>
Nov 14 16:08:06 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:08:06 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:08:06 user nova-compute[75097]:   <metadata>
Nov 14 16:08:06 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:08:06 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:08:06 user nova-compute[75097]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1053421887</nova:name>
Nov 14 16:08:06 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:08:04</nova:creationTime>
Nov 14 16:08:06 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:08:06 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:08:06 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:08:06 user nova-compute[75097]:       <nova:owner>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:user uuid="cd73d9a3d5f3487b8fdccf2a46c3736d">tempest-ServerActionsV293TestJSON-1509095738-project-member</nova:user>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:project uuid="fb9642780d214f218f29ba0ecc8204f3">tempest-ServerActionsV293TestJSON-1509095738</nova:project>
Nov 14 16:08:06 user nova-compute[75097]:       </nova:owner>
Nov 14 16:08:06 user nova-compute[75097]:       <nova:ports>
Nov 14 16:08:06 user nova-compute[75097]:         <nova:port uuid="43a2ed50-c777-4f1a-ae7f-f9b820c33fb5">
Nov 14 16:08:06 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 16:08:06 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:06 user nova-compute[75097]:       </nova:ports>
Nov 14 16:08:06 user nova-compute[75097]:     </nova:instance>
Nov 14 16:08:06 user nova-compute[75097]:   </metadata>
Nov 14 16:08:06 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:08:06 user nova-compute[75097]:     <system>
Nov 14 16:08:06 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:08:06 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:08:06 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:08:06 user nova-compute[75097]:       <entry name="serial">c34dc8a1-71ab-491d-a915-6f8e1f4f1d31</entry>
Nov 14 16:08:06 user nova-compute[75097]:       <entry name="uuid">c34dc8a1-71ab-491d-a915-6f8e1f4f1d31</entry>
Nov 14 16:08:06 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:08:06 user nova-compute[75097]:     </system>
Nov 14 16:08:06 user nova-compute[75097]:   </sysinfo>
Nov 14 16:08:06 user nova-compute[75097]:   <os>
Nov 14 16:08:06 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:08:06 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:08:06 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:08:06 user nova-compute[75097]:   </os>
Nov 14 16:08:06 user nova-compute[75097]:   <features>
Nov 14 16:08:06 user nova-compute[75097]:     <acpi/>
Nov 14 16:08:06 user nova-compute[75097]:     <apic/>
Nov 14 16:08:06 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:08:06 user nova-compute[75097]:   </features>
Nov 14 16:08:06 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:08:06 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:08:06 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:08:06 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:08:06 user nova-compute[75097]:   </clock>
Nov 14 16:08:06 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:08:06 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:08:06 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:08:06 user nova-compute[75097]:   </cpu>
Nov 14 16:08:06 user nova-compute[75097]:   <devices>
Nov 14 16:08:06 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:08:06 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:08:06 user nova-compute[75097]:       <source dev="/dev/sdd"/>
Nov 14 16:08:06 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:08:06 user nova-compute[75097]:       <serial>ce70618b-8eed-4afe-9d95-08498ea3e605</serial>
Nov 14 16:08:06 user nova-compute[75097]:     </disk>
Nov 14 16:08:06 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:06 user nova-compute[75097]:       <mac address="fa:16:3e:54:e5:8d"/>
Nov 14 16:08:06 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:06 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:06 user nova-compute[75097]:       <target dev="tap43a2ed50-c7"/>
Nov 14 16:08:06 user nova-compute[75097]:     </interface>
Nov 14 16:08:06 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:08:06 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31/console.log" append="off"/>
Nov 14 16:08:06 user nova-compute[75097]:     </serial>
Nov 14 16:08:06 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:08:06 user nova-compute[75097]:     <video>
Nov 14 16:08:06 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:06 user nova-compute[75097]:     </video>
Nov 14 16:08:06 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:08:06 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:08:06 user nova-compute[75097]:     </rng>
Nov 14 16:08:06 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:08:06 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:08:06 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:08:06 user nova-compute[75097]:     </memballoon>
Nov 14 16:08:06 user nova-compute[75097]:   </devices>
Nov 14 16:08:06 user nova-compute[75097]: </domain>
Nov 14 16:08:06 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1053421887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1193502518',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkIvTZHy4KCWvjGUuzJP72IVTPtf+u/1pwxKhzdWAgjAFhtu7cSu8Q5VgjjvuqBIuu0k8oCSQG24jxFaMwkUeI6BwpC/rxUeyNW5Q1nvMARgKI51zUDpJhGjgzc0MkrhQ==',key_name='tempest-keypair-2065858370',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb9642780d214f218f29ba0ecc8204f3',ramdisk_id='',reservation_id='r-yc0iaadf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1509095738',owner_user_name='tempest-ServerActionsV293TestJSON-1509095738-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd73d9a3d5f3487b8fdccf2a46c3736d',uuid=c34dc8a1-71ab-491d-a915-6f8e1f4f1d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converting VIF {"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG os_vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cedf6154-ca77-5ae8-920f-257260fd4142', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43a2ed50-c7, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43a2ed50-c7, col_values=(('qos', UUID('82cc96b5-0c0f-468d-9548-f5d063a540f4')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43a2ed50-c7, col_values=(('external_ids', {'iface-id': '43a2ed50-c777-4f1a-ae7f-f9b820c33fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:e5:8d', 'vm-uuid': 'c34dc8a1-71ab-491d-a915-6f8e1f4f1d31'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:06 user nova-compute[75097]: INFO os_vif [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7')
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:08:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] No VIF found with MAC fa:16:3e:54:e5:8d, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:08:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:08:09 user nova-compute[75097]: INFO nova.compute.claims [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Claim successful on node user
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:08:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance spawned successfully.
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:09 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.216s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.objects.instance [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75097) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-460617c3-e21b-4dce-b08a-702c3d846244 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:08:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.policy [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '664b6227948844139c66874de91fab7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e9e2ab228546a3b3d0b34f27bb5677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:08:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Creating image(s)
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Successfully created port: b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.part --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG nova.virt.images [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] dde149ce-fcc4-486a-a992-59b050089b91 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.part /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-9163e3b1-c1ae-4092-ab45-76a1115ccce5 req-a37a3361-f011-45f7-980e-b031abee0a54 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9163e3b1-c1ae-4092-ab45-76a1115ccce5 req-a37a3361-f011-45f7-980e-b031abee0a54 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9163e3b1-c1ae-4092-ab45-76a1115ccce5 req-a37a3361-f011-45f7-980e-b031abee0a54 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9163e3b1-c1ae-4092-ab45-76a1115ccce5 req-a37a3361-f011-45f7-980e-b031abee0a54 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-9163e3b1-c1ae-4092-ab45-76a1115ccce5 req-a37a3361-f011-45f7-980e-b031abee0a54 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:08:11 user nova-compute[75097]: WARNING nova.compute.manager [req-9163e3b1-c1ae-4092-ab45-76a1115ccce5 req-a37a3361-f011-45f7-980e-b031abee0a54 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state active and task_state None.
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.part /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.converted" returned: 0 in 0.229s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.252s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json" returned: 0 in 0.212s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789,backing_fmt=raw /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Successfully updated port: b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789,backing_fmt=raw /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk 1073741824" returned: 0 in 0.053s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Cannot resize image /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Ensure instance console log exists: /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance network_info: |[{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Start _get_guest_xml network_info=[{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T16:08:07Z,direct_url=<?>,disk_format='qcow2',id=dde149ce-fcc4-486a-a992-59b050089b91,min_disk=0,min_ram=0,name='tempest-scenario-img--380917229',owner='91e9e2ab228546a3b3d0b34f27bb5677',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T16:08:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'dde149ce-fcc4-486a-a992-59b050089b91'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:08:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:08:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T16:08:07Z,direct_url=<?>,disk_format='qcow2',id=dde149ce-fcc4-486a-a992-59b050089b91,min_disk=0,min_ram=0,name='tempest-scenario-img--380917229',owner='91e9e2ab228546a3b3d0b34f27bb5677',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T16:08:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-120930556',display_name='tempest-TestMinimumBasicScenario-server-120930556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-120930556',id=22,image_ref='dde149ce-fcc4-486a-a992-59b050089b91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3jBDAiF8kCAndilZ58Fs99JIfkE42J6F++n1FO3/O0tM2uNbRObIwQ2qLh02WXryHSD7wRS/gAjcahH75rfTvw3c2OF97XJ9va+szbkvd8N1XUkCpCvjT9T0yz5BC7Q==',key_name='tempest-TestMinimumBasicScenario-1286213988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-9000gmu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dde149ce-fcc4-486a-a992-59b050089b91',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:10Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=67309ef7-8e83-4074-9419-2b815f7319bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'pci_devices' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:08:12 user nova-compute[75097]:   <uuid>67309ef7-8e83-4074-9419-2b815f7319bc</uuid>
Nov 14 16:08:12 user nova-compute[75097]:   <name>instance-00000016</name>
Nov 14 16:08:12 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:08:12 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:08:12 user nova-compute[75097]:   <metadata>
Nov 14 16:08:12 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:08:12 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:08:12 user nova-compute[75097]:       <nova:name>tempest-TestMinimumBasicScenario-server-120930556</nova:name>
Nov 14 16:08:12 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:08:12</nova:creationTime>
Nov 14 16:08:12 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:08:12 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:08:12 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:08:12 user nova-compute[75097]:       <nova:owner>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:user uuid="664b6227948844139c66874de91fab7d">tempest-TestMinimumBasicScenario-359238341-project-member</nova:user>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:project uuid="91e9e2ab228546a3b3d0b34f27bb5677">tempest-TestMinimumBasicScenario-359238341</nova:project>
Nov 14 16:08:12 user nova-compute[75097]:       </nova:owner>
Nov 14 16:08:12 user nova-compute[75097]:       <nova:root type="image" uuid="dde149ce-fcc4-486a-a992-59b050089b91"/>
Nov 14 16:08:12 user nova-compute[75097]:       <nova:ports>
Nov 14 16:08:12 user nova-compute[75097]:         <nova:port uuid="b73faa98-1a48-4897-ae43-4ef1725547b2">
Nov 14 16:08:12 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:08:12 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:12 user nova-compute[75097]:       </nova:ports>
Nov 14 16:08:12 user nova-compute[75097]:     </nova:instance>
Nov 14 16:08:12 user nova-compute[75097]:   </metadata>
Nov 14 16:08:12 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:08:12 user nova-compute[75097]:     <system>
Nov 14 16:08:12 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:08:12 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:08:12 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:08:12 user nova-compute[75097]:       <entry name="serial">67309ef7-8e83-4074-9419-2b815f7319bc</entry>
Nov 14 16:08:12 user nova-compute[75097]:       <entry name="uuid">67309ef7-8e83-4074-9419-2b815f7319bc</entry>
Nov 14 16:08:12 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:08:12 user nova-compute[75097]:     </system>
Nov 14 16:08:12 user nova-compute[75097]:   </sysinfo>
Nov 14 16:08:12 user nova-compute[75097]:   <os>
Nov 14 16:08:12 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:08:12 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:08:12 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:08:12 user nova-compute[75097]:   </os>
Nov 14 16:08:12 user nova-compute[75097]:   <features>
Nov 14 16:08:12 user nova-compute[75097]:     <acpi/>
Nov 14 16:08:12 user nova-compute[75097]:     <apic/>
Nov 14 16:08:12 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:08:12 user nova-compute[75097]:   </features>
Nov 14 16:08:12 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:08:12 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:08:12 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:08:12 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:08:12 user nova-compute[75097]:   </clock>
Nov 14 16:08:12 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:08:12 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:08:12 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:08:12 user nova-compute[75097]:   </cpu>
Nov 14 16:08:12 user nova-compute[75097]:   <devices>
Nov 14 16:08:12 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:08:12 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:08:12 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk"/>
Nov 14 16:08:12 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:08:12 user nova-compute[75097]:     </disk>
Nov 14 16:08:12 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:12 user nova-compute[75097]:       <mac address="fa:16:3e:d1:b5:f0"/>
Nov 14 16:08:12 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:12 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:12 user nova-compute[75097]:       <target dev="tapb73faa98-1a"/>
Nov 14 16:08:12 user nova-compute[75097]:     </interface>
Nov 14 16:08:12 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:08:12 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/console.log" append="off"/>
Nov 14 16:08:12 user nova-compute[75097]:     </serial>
Nov 14 16:08:12 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:08:12 user nova-compute[75097]:     <video>
Nov 14 16:08:12 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:12 user nova-compute[75097]:     </video>
Nov 14 16:08:12 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:08:12 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:08:12 user nova-compute[75097]:     </rng>
Nov 14 16:08:12 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:08:12 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:08:12 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:08:12 user nova-compute[75097]:     </memballoon>
Nov 14 16:08:12 user nova-compute[75097]:   </devices>
Nov 14 16:08:12 user nova-compute[75097]: </domain>
Nov 14 16:08:12 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-120930556',display_name='tempest-TestMinimumBasicScenario-server-120930556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-120930556',id=22,image_ref='dde149ce-fcc4-486a-a992-59b050089b91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3jBDAiF8kCAndilZ58Fs99JIfkE42J6F++n1FO3/O0tM2uNbRObIwQ2qLh02WXryHSD7wRS/gAjcahH75rfTvw3c2OF97XJ9va+szbkvd8N1XUkCpCvjT9T0yz5BC7Q==',key_name='tempest-TestMinimumBasicScenario-1286213988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-9000gmu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dde149ce-fcc4-486a-a992-59b050089b91',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:10Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=67309ef7-8e83-4074-9419-2b815f7319bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG os_vif [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ad36fdd-b5f7-5b37-be30-3a067f6eeed5', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73faa98-1a, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73faa98-1a, col_values=(('qos', UUID('11076499-b6b5-465e-b51e-be0b4f536062')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73faa98-1a, col_values=(('external_ids', {'iface-id': 'b73faa98-1a48-4897-ae43-4ef1725547b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:b5:f0', 'vm-uuid': '67309ef7-8e83-4074-9419-2b815f7319bc'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:12 user nova-compute[75097]: INFO os_vif [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a')
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:08:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No VIF found with MAC fa:16:3e:d1:b5:f0, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:08:13 user nova-compute[75097]: WARNING nova.compute.manager [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state active and task_state None.
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing instance network info cache due to event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updated VIF entry in instance network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6f1f52e1-3baf-4cc6-b905-0fbfa958be44 req-9d882106-bd05-42ab-ab7f-654c31d9c1ff service nova] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2cb097c7-b363-47a3-9e5d-d1b188e607e2 req-e1733050-1e81-4d53-bf72-650afcbdf998 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2cb097c7-b363-47a3-9e5d-d1b188e607e2 req-e1733050-1e81-4d53-bf72-650afcbdf998 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2cb097c7-b363-47a3-9e5d-d1b188e607e2 req-e1733050-1e81-4d53-bf72-650afcbdf998 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2cb097c7-b363-47a3-9e5d-d1b188e607e2 req-e1733050-1e81-4d53-bf72-650afcbdf998 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2cb097c7-b363-47a3-9e5d-d1b188e607e2 req-e1733050-1e81-4d53-bf72-650afcbdf998 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:08:14 user nova-compute[75097]: WARNING nova.compute.manager [req-2cb097c7-b363-47a3-9e5d-d1b188e607e2 req-e1733050-1e81-4d53-bf72-650afcbdf998 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state building and task_state spawning.
Nov 14 16:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:08:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance spawned successfully.
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:08:16 user nova-compute[75097]: INFO nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-302597fa-18c9-4e24-84fd-08fb862e0294 req-d5439265-eebf-4cf5-92d9-021e7332ce45 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-302597fa-18c9-4e24-84fd-08fb862e0294 req-d5439265-eebf-4cf5-92d9-021e7332ce45 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-302597fa-18c9-4e24-84fd-08fb862e0294 req-d5439265-eebf-4cf5-92d9-021e7332ce45 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-302597fa-18c9-4e24-84fd-08fb862e0294 req-d5439265-eebf-4cf5-92d9-021e7332ce45 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-302597fa-18c9-4e24-84fd-08fb862e0294 req-d5439265-eebf-4cf5-92d9-021e7332ce45 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:08:16 user nova-compute[75097]: WARNING nova.compute.manager [req-302597fa-18c9-4e24-84fd-08fb862e0294 req-d5439265-eebf-4cf5-92d9-021e7332ce45 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state building and task_state spawning.
Nov 14 16:08:16 user nova-compute[75097]: INFO nova.compute.manager [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Took 7.06 seconds to build instance.
Nov 14 16:08:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e08803cc-3b77-40a5-b242-29be2f700cc3 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.168s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:08:40 user nova-compute[75097]: INFO nova.compute.claims [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Claim successful on node user
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:08:40 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: INFO nova.virt.block_device [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Booting with volume 3086622a-b4b7-4149-84bb-d0bb222e0641 at /dev/vda
Nov 14 16:08:40 user nova-compute[75097]: DEBUG os_brick.utils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18c9c9e-f726-46df-a50b-87f0fdb3afcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG nova.policy [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cc6e8e3ae26426f8888d88d1c064e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3400d5c07e4345d091d85c696a1914c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa96e943-49ff-48ee-a6da-91823d0f44d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2bcca7-2c0c-4216-979e-fffe245347cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca4847-a8d3-4c3a-b8ce-5170308f21f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:08:41 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f994ae0f-fa77-4b07-818f-9cbbe69eb496]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG os_brick.utils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating existing volume attachment record: 239d627d-4b80-45ee-9fec-8f063691728c {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully created port: 0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully created port: 97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:08:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7390MB free_disk=25.238048553466797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully created port: 36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f4eb61fa-ad89-4fad-b649-869efa6043c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 3003a213-db76-4a1d-bf0f-0f2fe8adba22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 67309ef7-8e83-4074-9419-2b815f7319bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:08:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:08:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:08:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully created port: b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:08:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully created port: 4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Skipping network cache update for instance because it is Building. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: 0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-0daf8da2-fb3b-42e1-b54f-b593f9800ff1. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port 0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updating instance_info_cache with network_info: [{"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:08:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-87181978-eba6-4950-88f0-d8a5591057d4 req-ebe288e6-6252-4cb4-838d-fff831432668 service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-b7859dba-f9c6-4972-afab-efc7e28261df. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ce80c489-ab51-4036-93fe-cce24219f2ac req-8253dc44-145b-4aa0-9acb-c29167090a26 service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:45 user nova-compute[75097]: INFO nova.virt.block_device [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Booting with volume c35df249-9f2c-4a17-9a15-d13e8d3aeb81 at /dev/vdb
Nov 14 16:08:45 user nova-compute[75097]: DEBUG os_brick.utils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0546a1b-372f-4493-881d-b39f872bd1b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9434448d-0e89-4161-9507-010c5f6cd4a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: 15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6492fee-d937-492e-ac77-9990984cee9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f17ce-2bc8-4834-b6d6-2defdce3764b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:08:45 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:08:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf70c4-9b39-425d-8b21-d01fbb22f8df]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG os_brick.utils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:45 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating existing volume attachment record: e7c3623e-ea14-4701-b8a1-54a309f8c3de {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:08:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:46 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: 97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:46 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: 36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-15cf14e1-98b3-4c5b-83fa-6412a6777c3a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port 15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port 97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-36048eab-4d91-42dc-942f-384bcacf1c56. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port 36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-873ebb68-e512-4a3d-bbc3-9b989ca52b13 req-aceaf796-e1a6-4b46-86c9-55d842a09ca1 service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Successfully updated port: 4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-4b592e2d-96d0-4ae0-9690-f8a36d529dac. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:08:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:08:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-b1ecd972-5d6c-4491-ba6c-7c9828bc3867. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:08:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:08:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance network_info: |[{"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port 4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updated VIF entry in instance network info cache for port 4b592e2d-96d0-4ae0-9690-f8a36d529dac. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1f515d12-588e-4885-a702-59823c15811e req-e6e261b9-19cd-4334-b46f-b5637d3cfd1a service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:08:50 user nova-compute[75097]: INFO nova.virt.block_device [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Booting with volume d6d8031d-f2e9-4a14-b087-ae61747d86c3 at /dev/vdc
Nov 14 16:08:50 user nova-compute[75097]: DEBUG os_brick.utils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4827670-a666-42a2-86ae-36e418097d9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868769e-cead-4c5f-9aa6-98a28ed3943e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e368cbf-8a17-4ccc-8e96-0b1235dca406]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e9f85c-bb19-4cd9-b590-36f43d895483]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:08:50 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:08:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[435df70d-2859-48e2-bd6e-5b0a459e6ee4]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG os_brick.utils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:50 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating existing volume attachment record: c51dcfe8-8e0a-404e-9837-b9f7a49ccc46 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:08:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updated VIF entry in instance network info cache for port b1ecd972-5d6c-4491-ba6c-7c9828bc3867. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:08:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:08:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-034dfd46-cb4b-40b0-a613-ccd9a56eef9d req-ed943bbb-c3e7-45d3-a1e4-70d17c49cd02 service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:08:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:08:55 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Creating image(s)
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Ensure instance console log exists: /opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Start _get_guest_xml network_info=[{"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzaTXWiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1', 'attached_at': '', 'detached_at': '', 'volume_id': '3086622a-b4b7-4149-84bb-d0bb222e0641', 'serial': '3086622a-b4b7-4149-84bb-d0bb222e0641'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '239d627d-4b80-45ee-9fec-8f063691728c', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvxAFHpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c35df249-9f2c-4a17-9a15-d13e8d3aeb81', 'serial': 'c35df249-9f2c-4a17-9a15-d13e8d3aeb81'}, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'e7c3623e-ea14-4701-b8a1-54a309f8c3de', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpOGjDXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6d8031d-f2e9-4a14-b087-ae61747d86c3', 'serial': 'd6d8031d-f2e9-4a14-b087-ae61747d86c3'}, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'c51dcfe8-8e0a-404e-9837-b9f7a49ccc46', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:08:55 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:08:55 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzaTXWiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:55 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:55 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:55 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7560c-3d29-4f8d-a9b5-5c79ec17e27b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:08:55 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a89df3-819c-4e48-879d-861058042954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641] added
Nov 14 16:08:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.085s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa1645-30bc-47c9-97e5-833aeeab46d3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25f3fae-416b-45ba-b75d-e5e2ce1c2bd4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MzaTXWiH {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MzaTXWiH" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26ad6b8-3d9d-49cd-83d1-85fb663b158b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MzaTXWiH'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939cda6-8f12-4a01-9528-3260ab6755ac]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f2f61-1b8f-415f-8337-77877d0bb0d6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc7b90-c115-48b5-a109-209536cddfad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260]
Nov 14 16:08:55 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260] successful.
Nov 14 16:08:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb23496-4a61-40ff-ae64-9cbe50001fec]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd855b61-3eb1-4b28-904a-65d2ba392975]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181cbe4-a77d-4005-ac53-740fd45ff729]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzaTXWiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26538646134663161', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538646134663161', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvxAFHpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:56 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555a6ce-34d6-4cd6-a599-f19e6951f813]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:08:56 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae16e4-97fa-43db-8ff9-997d63482bf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81] added
Nov 14 16:08:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcec48b-1511-4803-bdc2-095ff65ef14c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c73689d-ded0-45d2-a590-ae48b593db70]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvxAFHpU {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvxAFHpU" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1283bb-7003-40a2-b49e-1356af1c77a7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvxAFHpU'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[67086942-87c8-49f6-83b1-6d31993fd5f2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8486ab98-3285-41df-ab73-544b615a4c3b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4f42f-a521-4fc9-8c16-03ab88ed109f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260]
Nov 14 16:08:57 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260] successful.
Nov 14 16:08:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d998d0a-490e-41cc-b5e8-a241018b38b1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff03970-a1d4-4267-b77a-8730430abbb8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:08:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.035s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a95b09-6efc-4ecb-a817-20ee905f0a27]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:08:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvxAFHpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23536393361353836', 'path': '/dev/sdg'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536393361353836', 'path': '/dev/sdg'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpOGjDXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:08:58 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:58 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:08:58 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f58bd63-edc2-4001-9390-6af47ed7d737]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:08:58 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d235e-2f29-4c15-930c-16dfff021840]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3] added
Nov 14 16:08:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ab5c17-7d66-4f93-8157-6a333629a09d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f9df1-2d57-40f4-a0cf-b1974c774a3b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NpOGjDXH {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NpOGjDXH" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf134868-9276-44f1-aef1-63f6d92b6fa6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NpOGjDXH'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[330b7ebe-03a4-4772-9130-ea125940089d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0c674-9763-44d5-986d-2a7b114ca29f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafebed-0a43-4f2e-a191-6b06d9be8934]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260]
Nov 14 16:08:58 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260] successful.
Nov 14 16:08:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f34a9f8-b321-4b83-910c-69b9aba86393]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[800733a0-bf03-4b9a-ab7a-e18fa4061839]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:08:58 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[12052f08-270f-4f1f-bfb1-17155b302b04]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:08:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpOGjDXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23833386665623532', 'path': '/dev/sdh'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833386665623532', 'path': '/dev/sdh'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lazy-loading 'pci_devices' on Instance uuid c78c5ba9-5257-413d-b87c-7acb9506bbc1 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:08:59 user nova-compute[75097]:   <uuid>c78c5ba9-5257-413d-b87c-7acb9506bbc1</uuid>
Nov 14 16:08:59 user nova-compute[75097]:   <name>instance-00000017</name>
Nov 14 16:08:59 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:08:59 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:08:59 user nova-compute[75097]:   <metadata>
Nov 14 16:08:59 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:08:59 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:08:59 user nova-compute[75097]:       <nova:name>tempest-device-tagging-server-733476865</nova:name>
Nov 14 16:08:59 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:08:55</nova:creationTime>
Nov 14 16:08:59 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:08:59 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:08:59 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:08:59 user nova-compute[75097]:       <nova:owner>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:user uuid="0cc6e8e3ae26426f8888d88d1c064e3a">tempest-TaggedBootDevicesTest_v242-2001721703-project-member</nova:user>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:project uuid="3400d5c07e4345d091d85c696a1914c2">tempest-TaggedBootDevicesTest_v242-2001721703</nova:project>
Nov 14 16:08:59 user nova-compute[75097]:       </nova:owner>
Nov 14 16:08:59 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:08:59 user nova-compute[75097]:       <nova:ports>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="0daf8da2-fb3b-42e1-b54f-b593f9800ff1">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="b7859dba-f9c6-4972-afab-efc7e28261df">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="15cf14e1-98b3-4c5b-83fa-6412a6777c3a">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="97c5a7c4-b47e-4e39-a2b1-dcdcbe696241">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="36048eab-4d91-42dc-942f-384bcacf1c56">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="b1ecd972-5d6c-4491-ba6c-7c9828bc3867">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:         <nova:port uuid="4b592e2d-96d0-4ae0-9690-f8a36d529dac">
Nov 14 16:08:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 16:08:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:08:59 user nova-compute[75097]:       </nova:ports>
Nov 14 16:08:59 user nova-compute[75097]:     </nova:instance>
Nov 14 16:08:59 user nova-compute[75097]:   </metadata>
Nov 14 16:08:59 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:08:59 user nova-compute[75097]:     <system>
Nov 14 16:08:59 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:08:59 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:08:59 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:08:59 user nova-compute[75097]:       <entry name="serial">c78c5ba9-5257-413d-b87c-7acb9506bbc1</entry>
Nov 14 16:08:59 user nova-compute[75097]:       <entry name="uuid">c78c5ba9-5257-413d-b87c-7acb9506bbc1</entry>
Nov 14 16:08:59 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:08:59 user nova-compute[75097]:     </system>
Nov 14 16:08:59 user nova-compute[75097]:   </sysinfo>
Nov 14 16:08:59 user nova-compute[75097]:   <os>
Nov 14 16:08:59 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:08:59 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:08:59 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:08:59 user nova-compute[75097]:   </os>
Nov 14 16:08:59 user nova-compute[75097]:   <features>
Nov 14 16:08:59 user nova-compute[75097]:     <acpi/>
Nov 14 16:08:59 user nova-compute[75097]:     <apic/>
Nov 14 16:08:59 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:08:59 user nova-compute[75097]:   </features>
Nov 14 16:08:59 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:08:59 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:08:59 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:08:59 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:08:59 user nova-compute[75097]:   </clock>
Nov 14 16:08:59 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:08:59 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:08:59 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:08:59 user nova-compute[75097]:   </cpu>
Nov 14 16:08:59 user nova-compute[75097]:   <devices>
Nov 14 16:08:59 user nova-compute[75097]:     <disk type="file" device="cdrom">
Nov 14 16:08:59 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 16:08:59 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1/disk.config"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="hda" bus="ide"/>
Nov 14 16:08:59 user nova-compute[75097]:     </disk>
Nov 14 16:08:59 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:08:59 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:08:59 user nova-compute[75097]:       <source dev="/dev/sde"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <serial>3086622a-b4b7-4149-84bb-d0bb222e0641</serial>
Nov 14 16:08:59 user nova-compute[75097]:     </disk>
Nov 14 16:08:59 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:08:59 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:08:59 user nova-compute[75097]:       <source dev="/dev/sdg"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <serial>c35df249-9f2c-4a17-9a15-d13e8d3aeb81</serial>
Nov 14 16:08:59 user nova-compute[75097]:     </disk>
Nov 14 16:08:59 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:08:59 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:08:59 user nova-compute[75097]:       <source dev="/dev/sdh"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="vdc" bus="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <serial>d6d8031d-f2e9-4a14-b087-ae61747d86c3</serial>
Nov 14 16:08:59 user nova-compute[75097]:     </disk>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:c1:bc:ad"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tap0daf8da2-fb"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:82:35:01"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tapb7859dba-f9"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:dc:86:77"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tap15cf14e1-98"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:39:9a:4b"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tap97c5a7c4-b4"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:cb:21:bf"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tap36048eab-4d"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:11:e7:05"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tapb1ecd972-5d"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:08:59 user nova-compute[75097]:       <mac address="fa:16:3e:86:8a:3c"/>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:08:59 user nova-compute[75097]:       <target dev="tap4b592e2d-96"/>
Nov 14 16:08:59 user nova-compute[75097]:     </interface>
Nov 14 16:08:59 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:08:59 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1/console.log" append="off"/>
Nov 14 16:08:59 user nova-compute[75097]:     </serial>
Nov 14 16:08:59 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:08:59 user nova-compute[75097]:     <video>
Nov 14 16:08:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:08:59 user nova-compute[75097]:     </video>
Nov 14 16:08:59 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:08:59 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:08:59 user nova-compute[75097]:     </rng>
Nov 14 16:08:59 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:08:59 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:08:59 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:08:59 user nova-compute[75097]:     </memballoon>
Nov 14 16:08:59 user nova-compute[75097]:   </devices>
Nov 14 16:08:59 user nova-compute[75097]: </domain>
Nov 14 16:08:59 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ac5e067-f29c-50e9-bc23-b1525258886c', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0daf8da2-fb, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0daf8da2-fb, col_values=(('qos', UUID('39c07509-aada-49ed-93c3-8b4d5a4add87')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0daf8da2-fb, col_values=(('external_ids', {'iface-id': '0daf8da2-fb3b-42e1-b54f-b593f9800ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:bc:ad', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb')
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '031f54ba-e017-5008-911c-cc36fcd6bdcc', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7859dba-f9, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7859dba-f9, col_values=(('qos', UUID('c44ca2ae-99b6-49ba-a842-0636e543ba0d')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7859dba-f9, col_values=(('external_ids', {'iface-id': 'b7859dba-f9c6-4972-afab-efc7e28261df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:35:01', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9')
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b851d25d-866a-550d-8913-824bfeb4586a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15cf14e1-98, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15cf14e1-98, col_values=(('qos', UUID('00c1401a-0cb5-4631-9eb7-85eab56618b2')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15cf14e1-98, col_values=(('external_ids', {'iface-id': '15cf14e1-98b3-4c5b-83fa-6412a6777c3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:86:77', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98')
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c6ac395-fb2c-539c-b65f-725825243c45', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97c5a7c4-b4, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97c5a7c4-b4, col_values=(('qos', UUID('355f012c-8b58-46f0-b8ad-6d239ccf8b89')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97c5a7c4-b4, col_values=(('external_ids', {'iface-id': '97c5a7c4-b47e-4e39-a2b1-dcdcbe696241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:9a:4b', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4')
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de0646bd-093c-5f62-a512-e03470b98224', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36048eab-4d, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36048eab-4d, col_values=(('qos', UUID('a11385f9-2384-4f96-a96a-3fc1f5236291')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36048eab-4d, col_values=(('external_ids', {'iface-id': '36048eab-4d91-42dc-942f-384bcacf1c56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:21:bf', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d')
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37f4e2bd-be50-5bdd-a8f4-605f7ce36d54', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1ecd972-5d, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1ecd972-5d, col_values=(('qos', UUID('df3e2170-905e-4585-9a87-558ea3966cf4')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1ecd972-5d, col_values=(('external_ids', {'iface-id': 'b1ecd972-5d6c-4491-ba6c-7c9828bc3867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:e7:05', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d')
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8bff257-cdd6-53ea-8ace-c7fe8cfc6a67', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b592e2d-96, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b592e2d-96, col_values=(('qos', UUID('55de6530-9f01-4be7-8ade-4f337237fea5')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b592e2d-96, col_values=(('external_ids', {'iface-id': '4b592e2d-96d0-4ae0-9690-f8a36d529dac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:8a:3c', 'vm-uuid': 'c78c5ba9-5257-413d-b87c-7acb9506bbc1'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:00 user nova-compute[75097]: INFO os_vif [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96')
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] No BDM found with device name hda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] No VIF found with MAC fa:16:3e:c1:bc:ad, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] No VIF found with MAC fa:16:3e:cb:21:bf, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:09:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Using config drive
Nov 14 16:09:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Creating config drive at /opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1/disk.config
Nov 14 16:09:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfmg9f30m {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfmg9f30m" returned: 0 in 0.052s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-ef32e62d-ea37-4ec2-bd69-9a6528c71fe8 req-92afd55d-23c0-4d8d-873b-e69791b44052 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ef32e62d-ea37-4ec2-bd69-9a6528c71fe8 req-92afd55d-23c0-4d8d-873b-e69791b44052 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ef32e62d-ea37-4ec2-bd69-9a6528c71fe8 req-92afd55d-23c0-4d8d-873b-e69791b44052 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ef32e62d-ea37-4ec2-bd69-9a6528c71fe8 req-92afd55d-23c0-4d8d-873b-e69791b44052 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-ef32e62d-ea37-4ec2-bd69-9a6528c71fe8 req-92afd55d-23c0-4d8d-873b-e69791b44052 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:02 user nova-compute[75097]: WARNING nova.compute.manager [req-ef32e62d-ea37-4ec2-bd69-9a6528c71fe8 req-92afd55d-23c0-4d8d-873b-e69791b44052 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 for instance with vm_state building and task_state spawning.
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-8c7fd7c4-0bc5-4ff5-95bf-d34acaf0fd74 req-261681b2-d8f6-4930-b8bf-f18978c0f6a4 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8c7fd7c4-0bc5-4ff5-95bf-d34acaf0fd74 req-261681b2-d8f6-4930-b8bf-f18978c0f6a4 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8c7fd7c4-0bc5-4ff5-95bf-d34acaf0fd74 req-261681b2-d8f6-4930-b8bf-f18978c0f6a4 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8c7fd7c4-0bc5-4ff5-95bf-d34acaf0fd74 req-261681b2-d8f6-4930-b8bf-f18978c0f6a4 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-8c7fd7c4-0bc5-4ff5-95bf-d34acaf0fd74 req-261681b2-d8f6-4930-b8bf-f18978c0f6a4 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:02 user nova-compute[75097]: WARNING nova.compute.manager [req-8c7fd7c4-0bc5-4ff5-95bf-d34acaf0fd74 req-261681b2-d8f6-4930-b8bf-f18978c0f6a4 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df for instance with vm_state building and task_state spawning.
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-44e94842-d454-44f7-87c3-f41d5b740646 req-6189a4e5-0fc7-4352-8554-c55da13e4f3a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-44e94842-d454-44f7-87c3-f41d5b740646 req-6189a4e5-0fc7-4352-8554-c55da13e4f3a service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-44e94842-d454-44f7-87c3-f41d5b740646 req-6189a4e5-0fc7-4352-8554-c55da13e4f3a service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-44e94842-d454-44f7-87c3-f41d5b740646 req-6189a4e5-0fc7-4352-8554-c55da13e4f3a service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-44e94842-d454-44f7-87c3-f41d5b740646 req-6189a4e5-0fc7-4352-8554-c55da13e4f3a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:03 user nova-compute[75097]: WARNING nova.compute.manager [req-44e94842-d454-44f7-87c3-f41d5b740646 req-6189a4e5-0fc7-4352-8554-c55da13e4f3a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 for instance with vm_state building and task_state spawning.
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-471da3c4-5e56-4fa8-9140-f8f4a367e971 req-2e14dc11-a8bc-4202-8048-29c43d90a29f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:04 user nova-compute[75097]: WARNING nova.compute.manager [req-50bc6c39-7790-470b-b58d-5e781ad0294b req-8235bfde-ec7a-4f09-acc7-cbad7170d371 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 for instance with vm_state building and task_state spawning.
Nov 14 16:09:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-34eedb7f-1ef0-4fa7-8e64-b753fc841670 req-395b38ab-50f6-4b96-8a6a-68dfdf420fc4 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-34eedb7f-1ef0-4fa7-8e64-b753fc841670 req-395b38ab-50f6-4b96-8a6a-68dfdf420fc4 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-34eedb7f-1ef0-4fa7-8e64-b753fc841670 req-395b38ab-50f6-4b96-8a6a-68dfdf420fc4 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-34eedb7f-1ef0-4fa7-8e64-b753fc841670 req-395b38ab-50f6-4b96-8a6a-68dfdf420fc4 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-34eedb7f-1ef0-4fa7-8e64-b753fc841670 req-395b38ab-50f6-4b96-8a6a-68dfdf420fc4 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:05 user nova-compute[75097]: WARNING nova.compute.manager [req-34eedb7f-1ef0-4fa7-8e64-b753fc841670 req-395b38ab-50f6-4b96-8a6a-68dfdf420fc4 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 for instance with vm_state building and task_state spawning.
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:09:05 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance spawned successfully.
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:06 user nova-compute[75097]: INFO nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Took 10.61 seconds to spawn the instance on the hypervisor.
Nov 14 16:09:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:09:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:06 user nova-compute[75097]: INFO nova.compute.manager [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Took 26.04 seconds to build instance.
Nov 14 16:09:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cfc41d7-ecc0-44dc-aa1f-22066f86530e tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.148s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:09:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:09:08 user nova-compute[75097]: INFO nova.compute.claims [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Claim successful on node user
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:09:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.policy [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d1946be4a442eb9b3bc8343510f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826e20e537274874bd3e0236eca9629f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:09:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Creating image(s)
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk 1073741824" returned: 0 in 0.056s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Successfully created port: dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:09:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Cannot resize image /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Successfully updated port: dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing instance network info cache due to event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance network_info: |[{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.neutron [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Start _get_guest_xml network_info=[{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:09:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:09:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1796443693',display_name='tempest-ServerRescueNegativeTestJSON-server-1796443693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1796443693',id=24,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44dvZEELnb9RBytVGxDZvUPg76aN5i6tmwXWvRLUdI4cvikCU64842EES4HipdVTEqUy9GdUaB2rD/dqtGhF5f1kq4ZRAvnlrXclgvtE2WKLELATAZ+AL5UNWlJ9Q2KQ==',key_name='tempest-keypair-2030503793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-gvdr15to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=44342db6-8756-46db-a279-0557c24e5d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.objects.instance [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'pci_devices' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:09:10 user nova-compute[75097]:   <uuid>44342db6-8756-46db-a279-0557c24e5d2d</uuid>
Nov 14 16:09:10 user nova-compute[75097]:   <name>instance-00000018</name>
Nov 14 16:09:10 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:09:10 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:09:10 user nova-compute[75097]:   <metadata>
Nov 14 16:09:10 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:09:10 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:09:10 user nova-compute[75097]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1796443693</nova:name>
Nov 14 16:09:10 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:09:10</nova:creationTime>
Nov 14 16:09:10 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:09:10 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:09:10 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:09:10 user nova-compute[75097]:       <nova:owner>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:user uuid="a0d1946be4a442eb9b3bc8343510f656">tempest-ServerRescueNegativeTestJSON-2084860496-project-member</nova:user>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:project uuid="826e20e537274874bd3e0236eca9629f">tempest-ServerRescueNegativeTestJSON-2084860496</nova:project>
Nov 14 16:09:10 user nova-compute[75097]:       </nova:owner>
Nov 14 16:09:10 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:09:10 user nova-compute[75097]:       <nova:ports>
Nov 14 16:09:10 user nova-compute[75097]:         <nova:port uuid="dbed1766-e24b-471a-9559-c738f87ed9cb">
Nov 14 16:09:10 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 16:09:10 user nova-compute[75097]:         </nova:port>
Nov 14 16:09:10 user nova-compute[75097]:       </nova:ports>
Nov 14 16:09:10 user nova-compute[75097]:     </nova:instance>
Nov 14 16:09:10 user nova-compute[75097]:   </metadata>
Nov 14 16:09:10 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:09:10 user nova-compute[75097]:     <system>
Nov 14 16:09:10 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:09:10 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:09:10 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:09:10 user nova-compute[75097]:       <entry name="serial">44342db6-8756-46db-a279-0557c24e5d2d</entry>
Nov 14 16:09:10 user nova-compute[75097]:       <entry name="uuid">44342db6-8756-46db-a279-0557c24e5d2d</entry>
Nov 14 16:09:10 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:09:10 user nova-compute[75097]:     </system>
Nov 14 16:09:10 user nova-compute[75097]:   </sysinfo>
Nov 14 16:09:10 user nova-compute[75097]:   <os>
Nov 14 16:09:10 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:09:10 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:09:10 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:09:10 user nova-compute[75097]:   </os>
Nov 14 16:09:10 user nova-compute[75097]:   <features>
Nov 14 16:09:10 user nova-compute[75097]:     <acpi/>
Nov 14 16:09:10 user nova-compute[75097]:     <apic/>
Nov 14 16:09:10 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:09:10 user nova-compute[75097]:   </features>
Nov 14 16:09:10 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:09:10 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:09:10 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:09:10 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:09:10 user nova-compute[75097]:   </clock>
Nov 14 16:09:10 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:09:10 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:09:10 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:09:10 user nova-compute[75097]:   </cpu>
Nov 14 16:09:10 user nova-compute[75097]:   <devices>
Nov 14 16:09:10 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:09:10 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:09:10 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk"/>
Nov 14 16:09:10 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:09:10 user nova-compute[75097]:     </disk>
Nov 14 16:09:10 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:09:10 user nova-compute[75097]:       <mac address="fa:16:3e:6d:ff:4d"/>
Nov 14 16:09:10 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:09:10 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:09:10 user nova-compute[75097]:       <target dev="tapdbed1766-e2"/>
Nov 14 16:09:10 user nova-compute[75097]:     </interface>
Nov 14 16:09:10 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:09:10 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/console.log" append="off"/>
Nov 14 16:09:10 user nova-compute[75097]:     </serial>
Nov 14 16:09:10 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:09:10 user nova-compute[75097]:     <video>
Nov 14 16:09:10 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:09:10 user nova-compute[75097]:     </video>
Nov 14 16:09:10 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:09:10 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:09:10 user nova-compute[75097]:     </rng>
Nov 14 16:09:10 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:09:10 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:09:10 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:09:10 user nova-compute[75097]:     </memballoon>
Nov 14 16:09:10 user nova-compute[75097]:   </devices>
Nov 14 16:09:10 user nova-compute[75097]: </domain>
Nov 14 16:09:10 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1796443693',display_name='tempest-ServerRescueNegativeTestJSON-server-1796443693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1796443693',id=24,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44dvZEELnb9RBytVGxDZvUPg76aN5i6tmwXWvRLUdI4cvikCU64842EES4HipdVTEqUy9GdUaB2rD/dqtGhF5f1kq4ZRAvnlrXclgvtE2WKLELATAZ+AL5UNWlJ9Q2KQ==',key_name='tempest-keypair-2030503793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-gvdr15to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=44342db6-8756-46db-a279-0557c24e5d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG os_vif [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6806e7af-2930-5331-bc34-bc78a989c563', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbed1766-e2, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbed1766-e2, col_values=(('qos', UUID('de31785b-78f0-4814-85fa-8c31c7024acd')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbed1766-e2, col_values=(('external_ids', {'iface-id': 'dbed1766-e24b-471a-9559-c738f87ed9cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:ff:4d', 'vm-uuid': '44342db6-8756-46db-a279-0557c24e5d2d'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:10 user nova-compute[75097]: INFO os_vif [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2')
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:09:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:6d:ff:4d, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:09:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updated VIF entry in instance network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:09:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-13498322-38f9-4ccc-8c10-d8c629736ab8 req-f4b77a22-eee4-4a13-a192-8b62eb1d98b1 service nova] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-57ee5768-9c8d-47ce-86bc-ee7aa1d69598 req-00a293c6-8d88-4ae6-b45b-a3c439309d0d service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-57ee5768-9c8d-47ce-86bc-ee7aa1d69598 req-00a293c6-8d88-4ae6-b45b-a3c439309d0d service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-57ee5768-9c8d-47ce-86bc-ee7aa1d69598 req-00a293c6-8d88-4ae6-b45b-a3c439309d0d service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-57ee5768-9c8d-47ce-86bc-ee7aa1d69598 req-00a293c6-8d88-4ae6-b45b-a3c439309d0d service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-57ee5768-9c8d-47ce-86bc-ee7aa1d69598 req-00a293c6-8d88-4ae6-b45b-a3c439309d0d service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:12 user nova-compute[75097]: WARNING nova.compute.manager [req-57ee5768-9c8d-47ce-86bc-ee7aa1d69598 req-00a293c6-8d88-4ae6-b45b-a3c439309d0d service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state building and task_state spawning.
Nov 14 16:09:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-ece839f1-22d3-4131-a9ea-c06df2da6d80 req-f771be46-81e3-44ec-8a7f-f6064d33a3a8 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ece839f1-22d3-4131-a9ea-c06df2da6d80 req-f771be46-81e3-44ec-8a7f-f6064d33a3a8 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ece839f1-22d3-4131-a9ea-c06df2da6d80 req-f771be46-81e3-44ec-8a7f-f6064d33a3a8 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ece839f1-22d3-4131-a9ea-c06df2da6d80 req-f771be46-81e3-44ec-8a7f-f6064d33a3a8 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-ece839f1-22d3-4131-a9ea-c06df2da6d80 req-f771be46-81e3-44ec-8a7f-f6064d33a3a8 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:14 user nova-compute[75097]: WARNING nova.compute.manager [req-ece839f1-22d3-4131-a9ea-c06df2da6d80 req-f771be46-81e3-44ec-8a7f-f6064d33a3a8 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state building and task_state spawning.
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:09:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance spawned successfully.
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:09:14 user nova-compute[75097]: INFO nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 14 16:09:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:09:15 user nova-compute[75097]: INFO nova.compute.manager [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Took 6.60 seconds to build instance.
Nov 14 16:09:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a51a3a94-8dd2-470e-9ed1-a222cf8e16df tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.720s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:17 user nova-compute[75097]: INFO nova.compute.manager [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Terminating instance
Nov 14 16:09:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-1127d4af-b8a3-4d8d-88ff-11a14bde61df req-a2c269ce-e2a0-4f09-992c-f4cf6bcf0e79 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-vif-unplugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1127d4af-b8a3-4d8d-88ff-11a14bde61df req-a2c269ce-e2a0-4f09-992c-f4cf6bcf0e79 service nova] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1127d4af-b8a3-4d8d-88ff-11a14bde61df req-a2c269ce-e2a0-4f09-992c-f4cf6bcf0e79 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1127d4af-b8a3-4d8d-88ff-11a14bde61df req-a2c269ce-e2a0-4f09-992c-f4cf6bcf0e79 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-1127d4af-b8a3-4d8d-88ff-11a14bde61df req-a2c269ce-e2a0-4f09-992c-f4cf6bcf0e79 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] No waiting events found dispatching network-vif-unplugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-1127d4af-b8a3-4d8d-88ff-11a14bde61df req-a2c269ce-e2a0-4f09-992c-f4cf6bcf0e79 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-vif-unplugged-7816b140-b12b-4824-9056-10cd3599d212 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:09:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Instance destroyed successfully.
Nov 14 16:09:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lazy-loading 'resources' on Instance uuid 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1549134189',display_name='tempest-ServersNegativeTestJSON-server-1549134189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1549134189',id=2,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d925bff9b1de4d35bc1a0c84437c4a88',ramdisk_id='',reservation_id='r-6wtg2cvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-912372315',owner_user_name='tempest-ServersNegativeTestJSON-912372315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:00:50Z,user_data=None,user_id='d0c8e2c01a9a4defa352c3e3fcbb4f8c',uuid=2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converting VIF {"id": "7816b140-b12b-4824-9056-10cd3599d212", "address": "fa:16:3e:e1:91:d6", "network": {"id": "c6245c6c-9db6-4528-aee7-0a797cd5a4ae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1632643261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d925bff9b1de4d35bc1a0c84437c4a88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7816b140-b1", "ovs_interfaceid": "7816b140-b12b-4824-9056-10cd3599d212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG os_vif [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7816b140-b1, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69aca9d2-757d-4244-980c-07aa93b20a03) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:18 user nova-compute[75097]: INFO os_vif [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:91:d6,bridge_name='br-int',has_traffic_filtering=True,id=7816b140-b12b-4824-9056-10cd3599d212,network=Network(c6245c6c-9db6-4528-aee7-0a797cd5a4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7816b140-b1')
Nov 14 16:09:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Deleting instance files /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1_del
Nov 14 16:09:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Deletion of /opt/stack/data/nova/instances/2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1_del complete
Nov 14 16:09:18 user nova-compute[75097]: INFO nova.compute.manager [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 16:09:18 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:09:18 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:19 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Took 0.47 seconds to deallocate network for instance.
Nov 14 16:09:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-af926f97-72a3-489f-bfd3-96b5dd40582a req-e2e5b078-8311-499a-9dfa-9b457a709351 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-vif-deleted-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:19 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Deleted allocations for instance 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1
Nov 14 16:09:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-64840971-2297-41dc-873c-248f099427e9 tempest-ServersNegativeTestJSON-912372315 tempest-ServersNegativeTestJSON-912372315-project-member] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-796ffc76-e430-4692-949d-044a99599f9e req-574baf24-bb2b-4099-8807-fc5630c2c209 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received event network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-796ffc76-e430-4692-949d-044a99599f9e req-574baf24-bb2b-4099-8807-fc5630c2c209 service nova] Acquiring lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-796ffc76-e430-4692-949d-044a99599f9e req-574baf24-bb2b-4099-8807-fc5630c2c209 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-796ffc76-e430-4692-949d-044a99599f9e req-574baf24-bb2b-4099-8807-fc5630c2c209 service nova] Lock "2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-796ffc76-e430-4692-949d-044a99599f9e req-574baf24-bb2b-4099-8807-fc5630c2c209 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] No waiting events found dispatching network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:20 user nova-compute[75097]: WARNING nova.compute.manager [req-796ffc76-e430-4692-949d-044a99599f9e req-574baf24-bb2b-4099-8807-fc5630c2c209 service nova] [instance: 2cdb8c38-d0d1-4ed0-8196-d4bc95faa5c1] Received unexpected event network-vif-plugged-7816b140-b12b-4824-9056-10cd3599d212 for instance with vm_state deleted and task_state None.
Nov 14 16:09:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-changed-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Refreshing instance network info cache due to event network-changed-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:09:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] Acquiring lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:09:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] Acquired lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:09:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Refreshing network info cache for port 8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:09:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Updated VIF entry in instance network info cache for port 8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:09:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Updating instance_info_cache with network_info: [{"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-414ab776-5398-41ee-8bfb-48267e4426fc req-2fd5dc95-3827-485e-b869-ad7a3f56f0b4 service nova] Releasing lock "refresh_cache-3003a213-db76-4a1d-bf0f-0f2fe8adba22" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:22 user nova-compute[75097]: INFO nova.compute.manager [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Terminating instance
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Instance destroyed successfully.
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'resources' on Instance uuid 3003a213-db76-4a1d-bf0f-0f2fe8adba22 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1061920894',display_name='tempest-AttachVolumeNegativeTest-server-1061920894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1061920894',id=21,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWQ9oscQqo5b6U7EIlTay64zVPSGqVkwOw1uPZOl032K0W/0I5lKO8YS/ghbaLsP3CtOTCBERxvXUK1JYna+R0iVFanUOUoJEvvrO4SNiQOeBaeoY9qYKjcbyjQ5hSQfw==',key_name='tempest-keypair-2002112897',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-0fxtykew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=3003a213-db76-4a1d-bf0f-0f2fe8adba22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "address": "fa:16:3e:11:7c:d4", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edf79d3-6d", "ovs_interfaceid": "8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG os_vif [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8edf79d3-6d, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad5552ef-489f-4814-8a09-d79e610f7080) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:22 user nova-compute[75097]: INFO os_vif [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7c:d4,bridge_name='br-int',has_traffic_filtering=True,id=8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edf79d3-6d')
Nov 14 16:09:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Deleting instance files /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22_del
Nov 14 16:09:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Deletion of /opt/stack/data/nova/instances/3003a213-db76-4a1d-bf0f-0f2fe8adba22_del complete
Nov 14 16:09:22 user nova-compute[75097]: INFO nova.compute.manager [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 14 16:09:22 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:09:22 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-vif-unplugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] No waiting events found dispatching network-vif-unplugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-vif-unplugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] Acquiring lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] No waiting events found dispatching network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:23 user nova-compute[75097]: WARNING nova.compute.manager [req-00423739-bf47-4ce7-a0f0-deb6ad31cc0f req-7c0e627f-ab8d-409a-b651-02e4ed8b69f5 service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received unexpected event network-vif-plugged-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c for instance with vm_state active and task_state deleting.
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:23 user nova-compute[75097]: INFO nova.compute.manager [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Detaching volume 13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:23 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Took 1.15 seconds to deallocate network for instance.
Nov 14 16:09:23 user nova-compute[75097]: INFO nova.virt.block_device [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Attempting to driver detach volume 13e87877-2380-48a3-894d-58955eca5e67 from mountpoint /dev/vdb
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Attempting to detach device vdb from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:09:23 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:09:23 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:09:23 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:09:23 user nova-compute[75097]:   <serial>13e87877-2380-48a3-894d-58955eca5e67</serial>
Nov 14 16:09:23 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:09:23 user nova-compute[75097]: </disk>
Nov 14 16:09:23 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:09:23 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully detached device vdb from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 from the persistent domain config.
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:09:23 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:09:23 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:09:23 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:09:23 user nova-compute[75097]:   <serial>13e87877-2380-48a3-894d-58955eca5e67</serial>
Nov 14 16:09:23 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:09:23 user nova-compute[75097]: </disk>
Nov 14 16:09:23 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:24 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:24 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:09:24 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Deleted allocations for instance 3003a213-db76-4a1d-bf0f-0f2fe8adba22
Nov 14 16:09:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-72509b75-f7d0-4562-bd1a-dd94b9640c94 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "3003a213-db76-4a1d-bf0f-0f2fe8adba22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:25 user nova-compute[75097]: INFO nova.compute.manager [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Terminating instance
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:25 user nova-compute[75097]: INFO nova.compute.manager [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Unshelving
Nov 14 16:09:25 user nova-compute[75097]: INFO nova.virt.block_device [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Booting with volume 72d47ead-46be-4262-a78a-e2ed8c151a70 at /dev/vda
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-a7b949ef-f2c2-4881-b65d-c6534ee9ac7a req-1dc7a1e6-90b2-4f96-be54-8f8293447a8b service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a7b949ef-f2c2-4881-b65d-c6534ee9ac7a req-1dc7a1e6-90b2-4f96-be54-8f8293447a8b service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a7b949ef-f2c2-4881-b65d-c6534ee9ac7a req-1dc7a1e6-90b2-4f96-be54-8f8293447a8b service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a7b949ef-f2c2-4881-b65d-c6534ee9ac7a req-1dc7a1e6-90b2-4f96-be54-8f8293447a8b service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-a7b949ef-f2c2-4881-b65d-c6534ee9ac7a req-1dc7a1e6-90b2-4f96-be54-8f8293447a8b service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-a7b949ef-f2c2-4881-b65d-c6534ee9ac7a req-1dc7a1e6-90b2-4f96-be54-8f8293447a8b service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-unplugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367e1d1-8934-4aa7-8bf7-18fb86aaa140]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa85ed-11b2-4ff9-9434-c1dcf35c6b73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0560ff09-be30-4baf-ab94-a82648097266]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0963d6ee-02d4-4e56-828a-c1ab5cc171da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-9a012ee5-5cfa-4e15-86c7-42a4217791fe req-c15782ce-7074-4ae9-851e-e778601fc93b service nova] [instance: 3003a213-db76-4a1d-bf0f-0f2fe8adba22] Received event network-vif-deleted-8edf79d3-6ddc-4922-a4ac-b87bfcf7ad3c {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:09:25 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:09:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6c41df-a8d5-47ef-bb37-98f49115c4b1]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating existing volume attachment record: 12c8c61f-dbf0-4350-9733-07758bd3f8de {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:09:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Instance destroyed successfully.
Nov 14 16:09:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lazy-loading 'resources' on Instance uuid 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-462759233',display_name='tempest-ServerActionsTestOtherB-server-462759233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-462759233',id=5,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlcnEdD8PmVyg+1dEAv3Q73bH/hC9AXtI45+3103FeoPvoX/cpTmEeiTWn7hEJIOf0uGbWPxNt8hs/H9o6jT5YiUEcny5ACKCJZZCEFHUxPVarQ2MFjhN2pjhhVIS8S8Q==',key_name='tempest-keypair-2073358025',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0301ebf075c14cee925c28d1e74b1598',ramdisk_id='',reservation_id='r-39w6dv30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-652208077',owner_user_name='tempest-ServerActionsTestOtherB-652208077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='257dfabc0d374fdcaf4897d360547fb5',uuid=0eaff6ee-9806-4f4b-9492-ccc8328a63e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converting VIF {"id": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "address": "fa:16:3e:37:e9:7c", "network": {"id": "a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-979322385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0301ebf075c14cee925c28d1e74b1598", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665262a2-60", "ovs_interfaceid": "665262a2-60e0-4453-aa2e-2e6373bc86cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_vif [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap665262a2-60, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=708ba44d-cdfe-4110-a1ad-09c29342627f) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:26 user nova-compute[75097]: INFO os_vif [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=665262a2-60e0-4453-aa2e-2e6373bc86cf,network=Network(a2fc9e4d-1884-47bb-8fc1-baa6186e7ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665262a2-60')
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tDRdhbci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:09:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b9e5d5-dbd2-491c-86c6-4bc4ef41dd07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:09:26 user nova-compute[75097]: No targets found.
Nov 14 16:09:26 user nova-compute[75097]: iSNS:
Nov 14 16:09:26 user nova-compute[75097]: No targets found.
Nov 14 16:09:26 user nova-compute[75097]: STATIC:
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:09:26 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:26 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:26 user nova-compute[75097]: FIRMWARE:
Nov 14 16:09:26 user nova-compute[75097]: No targets found.
Nov 14 16:09:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:09:26 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:09:26 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f433de-3e33-44c6-955b-9642102e1fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1a52d3-bf75-4aa0-bcff-ae0f8fbe74f7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf78706560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a861af41-e57e-4d13-a82e-1f9731a5325e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74117d8f-1349-4360-8f30-3fe4f867ef8a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783a469-86de-4cec-a7eb-72805289fb26]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5873440-79d7-461b-ae3b-fd1d0d03ed30]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65657ed-46b6-4a81-ae8c-26104ac3bcda]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[62701504-36e9-48e1-8102-75ee995a5722]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260]
Nov 14 16:09:26 user nova-compute[75097]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc, portal: 172.16.0.220,3260] successful.
Nov 14 16:09:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c2fdb9-1a51-491b-9e80-42da8796edfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[690474f0-501c-4e8f-8d86-6e985de971b3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] <== disconnect_volume: return (319ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:09:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Deleting instance files /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0_del
Nov 14 16:09:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Deletion of /opt/stack/data/nova/instances/0eaff6ee-9806-4f4b-9492-ccc8328a63e0_del complete
Nov 14 16:09:26 user nova-compute[75097]: INFO nova.compute.manager [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 16:09:26 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:09:26 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:09:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-36cbba41-229b-400a-ac47-9743b3e317e6 req-06660ba3-814b-4633-b86b-463191f1bf0d service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36cbba41-229b-400a-ac47-9743b3e317e6 req-06660ba3-814b-4633-b86b-463191f1bf0d service nova] Acquiring lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36cbba41-229b-400a-ac47-9743b3e317e6 req-06660ba3-814b-4633-b86b-463191f1bf0d service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36cbba41-229b-400a-ac47-9743b3e317e6 req-06660ba3-814b-4633-b86b-463191f1bf0d service nova] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-36cbba41-229b-400a-ac47-9743b3e317e6 req-06660ba3-814b-4633-b86b-463191f1bf0d service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] No waiting events found dispatching network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:27 user nova-compute[75097]: WARNING nova.compute.manager [req-36cbba41-229b-400a-ac47-9743b3e317e6 req-06660ba3-814b-4633-b86b-463191f1bf0d service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received unexpected event network-vif-plugged-665262a2-60e0-4453-aa2e-2e6373bc86cf for instance with vm_state active and task_state deleting.
Nov 14 16:09:27 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:27 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Took 1.33 seconds to deallocate network for instance.
Nov 14 16:09:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-efbeb886-9ef3-4329-85ed-e398748af099 req-4c57e45a-113b-4bc9-96a0-ee09126deb79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Received event network-vif-deleted-665262a2-60e0-4453-aa2e-2e6373bc86cf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:27 user nova-compute[75097]: INFO nova.compute.manager [req-efbeb886-9ef3-4329-85ed-e398748af099 req-4c57e45a-113b-4bc9-96a0-ee09126deb79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Neutron deleted interface 665262a2-60e0-4453-aa2e-2e6373bc86cf; detaching it from the instance and deleting it from the info cache
Nov 14 16:09:27 user nova-compute[75097]: DEBUG nova.network.neutron [req-efbeb886-9ef3-4329-85ed-e398748af099 req-4c57e45a-113b-4bc9-96a0-ee09126deb79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-efbeb886-9ef3-4329-85ed-e398748af099 req-4c57e45a-113b-4bc9-96a0-ee09126deb79 service nova] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Detach interface failed, port_id=665262a2-60e0-4453-aa2e-2e6373bc86cf, reason: Instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:09:29 user nova-compute[75097]: INFO nova.compute.manager [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] [instance: 0eaff6ee-9806-4f4b-9492-ccc8328a63e0] Took 1.29 seconds to detach 1 volumes for instance.
Nov 14 16:09:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:29 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:29 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Deleted allocations for instance 0eaff6ee-9806-4f4b-9492-ccc8328a63e0
Nov 14 16:09:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e197cde9-b035-4b24-bcdf-f719d27cdc04 tempest-ServerActionsTestOtherB-652208077 tempest-ServerActionsTestOtherB-652208077-project-member] Lock "0eaff6ee-9806-4f4b-9492-ccc8328a63e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.419s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'pci_requests' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'numa_topology' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:09:30 user nova-compute[75097]: INFO nova.compute.claims [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Claim successful on node user
Nov 14 16:09:30 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:30 user nova-compute[75097]: INFO nova.network.neutron [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing instance network info cache due to event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:09:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Creating image(s)
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Ensure instance console log exists: /opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Start _get_guest_xml network_info=[{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17946bc0-ba29-42a0-8993-74699b98d836', 'attached_at': '', 'detached_at': '', 'volume_id': '72d47ead-46be-4262-a78a-e2ed8c151a70', 'serial': '72d47ead-46be-4262-a78a-e2ed8c151a70'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '12c8c61f-dbf0-4350-9733-07758bd3f8de', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.network.neutron [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:09:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:09:31 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:31 user nova-compute[75097]: DEBUG nova.objects.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Object Instance<17946bc0-ba29-42a0-8993-74699b98d836> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:09:32 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:09:32 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:09:32 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3769a091-c2b9-4dac-a202-7cf8d83e0417]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:09:32 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea4a54e-3fd1-4ea2-ba35-b1aa448dc5b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70] added
Nov 14 16:09:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f82464-16a7-402f-805a-613f063a8957]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e479188b-ef56-404f-84e1-2adfc806786b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiJOcdDA {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PiJOcdDA" returned: 0 in 0.111s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be08075-a1bd-4e3c-9397-90290477d4b7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PiJOcdDA'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc78bd4d-0fa6-4690-8007-287676349fce]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e0b703-8d93-4649-b853-1988c9f98467]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updated VIF entry in instance network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b16ddfd1-f8fc-43d3-8f77-0fb928991dba req-ae5c8fb2-d49b-46c8-8a7c-8e5118688994 service nova] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b63cf25-fd4f-4f00-878b-09ad4b70f4ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]
Nov 14 16:09:32 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.
Nov 14 16:09:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f56206-b8f4-4335-a016-80345cce840d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f11ceb-8f10-4721-8a5b-452d4666fcbb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:09:32 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b906aaf-d64e-43c5-9fcf-26430d7d97b7]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:09:32 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26637303636363832', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637303636363832', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-919452920',display_name='tempest-TestShelveInstance-server-919452920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-919452920',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-372931991',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6d8fef64a574c1a8f84050f13037e65',ramdisk_id='',reservation_id='r-fb53j1rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2055532680',owner_user_name='tempest-TestShelveInstance-2055532680-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:26Z,user_data=None,user_id='fb8d8995adaf45e985b4b89db7aa0f1d',uuid=17946bc0-ba29-42a0-8993-74699b98d836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converting VIF {"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'pci_devices' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.objects.base [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Object Instance<17946bc0-ba29-42a0-8993-74699b98d836> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:09:33 user nova-compute[75097]:   <uuid>17946bc0-ba29-42a0-8993-74699b98d836</uuid>
Nov 14 16:09:33 user nova-compute[75097]:   <name>instance-00000013</name>
Nov 14 16:09:33 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:09:33 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:09:33 user nova-compute[75097]:   <metadata>
Nov 14 16:09:33 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:09:33 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:09:33 user nova-compute[75097]:       <nova:name>tempest-TestShelveInstance-server-919452920</nova:name>
Nov 14 16:09:33 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:09:31</nova:creationTime>
Nov 14 16:09:33 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:09:33 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:09:33 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:09:33 user nova-compute[75097]:       <nova:owner>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:user uuid="fb8d8995adaf45e985b4b89db7aa0f1d">tempest-TestShelveInstance-2055532680-project-member</nova:user>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:project uuid="e6d8fef64a574c1a8f84050f13037e65">tempest-TestShelveInstance-2055532680</nova:project>
Nov 14 16:09:33 user nova-compute[75097]:       </nova:owner>
Nov 14 16:09:33 user nova-compute[75097]:       <nova:ports>
Nov 14 16:09:33 user nova-compute[75097]:         <nova:port uuid="dbabe2fe-db2b-40eb-96d5-1d064d9c48c5">
Nov 14 16:09:33 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:09:33 user nova-compute[75097]:         </nova:port>
Nov 14 16:09:33 user nova-compute[75097]:       </nova:ports>
Nov 14 16:09:33 user nova-compute[75097]:     </nova:instance>
Nov 14 16:09:33 user nova-compute[75097]:   </metadata>
Nov 14 16:09:33 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:09:33 user nova-compute[75097]:     <system>
Nov 14 16:09:33 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:09:33 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:09:33 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:09:33 user nova-compute[75097]:       <entry name="serial">17946bc0-ba29-42a0-8993-74699b98d836</entry>
Nov 14 16:09:33 user nova-compute[75097]:       <entry name="uuid">17946bc0-ba29-42a0-8993-74699b98d836</entry>
Nov 14 16:09:33 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:09:33 user nova-compute[75097]:     </system>
Nov 14 16:09:33 user nova-compute[75097]:   </sysinfo>
Nov 14 16:09:33 user nova-compute[75097]:   <os>
Nov 14 16:09:33 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:09:33 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:09:33 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:09:33 user nova-compute[75097]:   </os>
Nov 14 16:09:33 user nova-compute[75097]:   <features>
Nov 14 16:09:33 user nova-compute[75097]:     <acpi/>
Nov 14 16:09:33 user nova-compute[75097]:     <apic/>
Nov 14 16:09:33 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:09:33 user nova-compute[75097]:   </features>
Nov 14 16:09:33 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:09:33 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:09:33 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:09:33 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:09:33 user nova-compute[75097]:   </clock>
Nov 14 16:09:33 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:09:33 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:09:33 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:09:33 user nova-compute[75097]:   </cpu>
Nov 14 16:09:33 user nova-compute[75097]:   <devices>
Nov 14 16:09:33 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:09:33 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:09:33 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:09:33 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:09:33 user nova-compute[75097]:       <serial>72d47ead-46be-4262-a78a-e2ed8c151a70</serial>
Nov 14 16:09:33 user nova-compute[75097]:     </disk>
Nov 14 16:09:33 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:09:33 user nova-compute[75097]:       <mac address="fa:16:3e:63:8c:2e"/>
Nov 14 16:09:33 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:09:33 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:09:33 user nova-compute[75097]:       <target dev="tapdbabe2fe-db"/>
Nov 14 16:09:33 user nova-compute[75097]:     </interface>
Nov 14 16:09:33 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:09:33 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836/console.log" append="off"/>
Nov 14 16:09:33 user nova-compute[75097]:     </serial>
Nov 14 16:09:33 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:09:33 user nova-compute[75097]:     <video>
Nov 14 16:09:33 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:09:33 user nova-compute[75097]:     </video>
Nov 14 16:09:33 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:09:33 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:09:33 user nova-compute[75097]:     </rng>
Nov 14 16:09:33 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:09:33 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:09:33 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:09:33 user nova-compute[75097]:     </memballoon>
Nov 14 16:09:33 user nova-compute[75097]:   </devices>
Nov 14 16:09:33 user nova-compute[75097]: </domain>
Nov 14 16:09:33 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-919452920',display_name='tempest-TestShelveInstance-server-919452920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-919452920',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-372931991',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6d8fef64a574c1a8f84050f13037e65',ramdisk_id='',reservation_id='r-fb53j1rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2055532680',owner_user_name='tempest-TestShelveInstance-2055532680-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:26Z,user_data=None,user_id='fb8d8995adaf45e985b4b89db7aa0f1d',uuid=17946bc0-ba29-42a0-8993-74699b98d836,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converting VIF {"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG os_vif [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a071268b-74d6-52ec-a649-2e7e46f3cb4a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbabe2fe-db, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbabe2fe-db, col_values=(('qos', UUID('24494cb7-f80d-4a7b-96be-775f6351a221')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbabe2fe-db, col_values=(('external_ids', {'iface-id': 'dbabe2fe-db2b-40eb-96d5-1d064d9c48c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:8c:2e', 'vm-uuid': '17946bc0-ba29-42a0-8993-74699b98d836'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:33 user nova-compute[75097]: INFO os_vif [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db')
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:09:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] No VIF found with MAC fa:16:3e:63:8c:2e, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:34 user nova-compute[75097]: INFO nova.compute.manager [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Terminating instance
Nov 14 16:09:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-b3aa7c77-41fa-484e-b2e5-f91fabfb9f25 req-db2d8235-8ca8-435c-9062-34f7b1af4834 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-unplugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b3aa7c77-41fa-484e-b2e5-f91fabfb9f25 req-db2d8235-8ca8-435c-9062-34f7b1af4834 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b3aa7c77-41fa-484e-b2e5-f91fabfb9f25 req-db2d8235-8ca8-435c-9062-34f7b1af4834 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b3aa7c77-41fa-484e-b2e5-f91fabfb9f25 req-db2d8235-8ca8-435c-9062-34f7b1af4834 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-b3aa7c77-41fa-484e-b2e5-f91fabfb9f25 req-db2d8235-8ca8-435c-9062-34f7b1af4834 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-unplugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-b3aa7c77-41fa-484e-b2e5-f91fabfb9f25 req-db2d8235-8ca8-435c-9062-34f7b1af4834 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-unplugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:09:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Instance destroyed successfully.
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lazy-loading 'resources' on Instance uuid c34dc8a1-71ab-491d-a915-6f8e1f4f1d31 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1053421887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1193502518',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkIvTZHy4KCWvjGUuzJP72IVTPtf+u/1pwxKhzdWAgjAFhtu7cSu8Q5VgjjvuqBIuu0k8oCSQG24jxFaMwkUeI6BwpC/rxUeyNW5Q1nvMARgKI51zUDpJhGjgzc0MkrhQ==',key_name='tempest-keypair-2065858370',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:08:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb9642780d214f218f29ba0ecc8204f3',ramdisk_id='',reservation_id='r-yc0iaadf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1509095738',owner_user_name='tempest-ServerActionsV293TestJSON-1509095738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd73d9a3d5f3487b8fdccf2a46c3736d',uuid=c34dc8a1-71ab-491d-a915-6f8e1f4f1d31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converting VIF {"id": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "address": "fa:16:3e:54:e5:8d", "network": {"id": "971d2072-78be-4f97-836b-28bbe6462f38", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981733632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb9642780d214f218f29ba0ecc8204f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a2ed50-c7", "ovs_interfaceid": "43a2ed50-c777-4f1a-ae7f-f9b820c33fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_vif [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43a2ed50-c7, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82cc96b5-0c0f-468d-9548-f5d063a540f4) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:09:35 user nova-compute[75097]: INFO os_vif [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e5:8d,bridge_name='br-int',has_traffic_filtering=True,id=43a2ed50-c777-4f1a-ae7f-f9b820c33fb5,network=Network(971d2072-78be-4f97-836b-28bbe6462f38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a2ed50-c7')
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cmGUJsAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:09:35 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[43788544-82e9-4bbc-9265-53f9c99fc6cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:09:35 user nova-compute[75097]: No targets found.
Nov 14 16:09:35 user nova-compute[75097]: iSNS:
Nov 14 16:09:35 user nova-compute[75097]: No targets found.
Nov 14 16:09:35 user nova-compute[75097]: STATIC:
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:09:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:35 user nova-compute[75097]: FIRMWARE:
Nov 14 16:09:35 user nova-compute[75097]: No targets found.
Nov 14 16:09:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:09:35 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:09:35 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ef5d6-d135-48d4-82e5-4a5ddd4b7004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d043d6c-e53c-4f18-a520-0ca9b8758402]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:09:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981d5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c733f-dfed-4c8c-92a9-6d1dc7089de6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a4c34-2d71-414c-9e37-3cc5bc596d0c]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f20e5-4ada-4a1b-8366-191c14c1bedf]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8700e66-4f26-47e2-bd03-8772d6a69c05]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee7f94e-219d-4ef1-89e4-4325e231ac24]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce51875-4810-4aeb-b125-983cd63ffa7d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260]
Nov 14 16:09:35 user nova-compute[75097]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605, portal: 172.16.0.220,3260] successful.
Nov 14 16:09:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce70618b-8eed-4afe-9d95-08498ea3e605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a284568-cc2e-4328-af1d-38ccc1a823cd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] <== disconnect_volume: return (351ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:09:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Deleting instance files /opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31_del
Nov 14 16:09:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Deletion of /opt/stack/data/nova/instances/c34dc8a1-71ab-491d-a915-6f8e1f4f1d31_del complete
Nov 14 16:09:35 user nova-compute[75097]: INFO nova.compute.manager [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 14 16:09:35 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:09:35 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:09:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:36 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:36 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Took 0.75 seconds to deallocate network for instance.
Nov 14 16:09:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-d222a2c8-0b2f-4e57-b637-7b130839c48f req-d4ba5338-444e-49d9-80ba-9c7b5db0937b service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-deleted-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Acquiring lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] No waiting events found dispatching network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:37 user nova-compute[75097]: WARNING nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Received unexpected event network-vif-plugged-43a2ed50-c777-4f1a-ae7f-f9b820c33fb5 for instance with vm_state active and task_state deleting.
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:37 user nova-compute[75097]: WARNING nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:09:37 user nova-compute[75097]: WARNING nova.compute.manager [req-8ace571b-0891-4f0e-a4bf-da8a3bd9e153 req-7511593b-c9a7-4ba3-a3d3-cb147195dc39 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:09:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance spawned successfully.
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0636a83a-6c7f-4ac6-9f9e-d346f740bdd7 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.864s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:37 user nova-compute[75097]: INFO nova.compute.manager [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] [instance: c34dc8a1-71ab-491d-a915-6f8e1f4f1d31] Deleting volume: ce70618b-8eed-4afe-9d95-08498ea3e605 {{(pid=75097) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:37 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Deleted allocations for instance c34dc8a1-71ab-491d-a915-6f8e1f4f1d31
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61ab367a-9f78-4fe5-a369-b7e2d218a094 tempest-ServerActionsV293TestJSON-1509095738 tempest-ServerActionsV293TestJSON-1509095738-project-member] Lock "c34dc8a1-71ab-491d-a915-6f8e1f4f1d31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.493s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:09:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:09:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7545MB free_disk=25.279510498046875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f4eb61fa-ad89-4fad-b649-869efa6043c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 67309ef7-8e83-4074-9419-2b815f7319bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 44342db6-8756-46db-a279-0557c24e5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 17946bc0-ba29-42a0-8993-74699b98d836 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:09:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:09:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:09:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:09:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:09:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:09:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 is timed out.
Nov 14 16:09:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully detached device vdb from instance f4eb61fa-ad89-4fad-b649-869efa6043c0 from the live domain config.
Nov 14 16:09:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHpcPar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:09:44 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1260de3c-d6cb-4d1e-908b-6f6f8604cb14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:09:44 user nova-compute[75097]: No targets found.
Nov 14 16:09:44 user nova-compute[75097]: iSNS:
Nov 14 16:09:44 user nova-compute[75097]: No targets found.
Nov 14 16:09:44 user nova-compute[75097]: STATIC:
Nov 14 16:09:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:09:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:09:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:09:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67
Nov 14 16:09:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641
Nov 14 16:09:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:09:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:09:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:09:44 user nova-compute[75097]: FIRMWARE:
Nov 14 16:09:44 user nova-compute[75097]: No targets found.
Nov 14 16:09:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:09:44 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:09:44 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a2758-878d-4486-a705-aec60a2d179b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dbb0f7-47bf-4cf8-b6ef-cb3a4476680d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:09:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf984a9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8675c7b8-a021-4edb-b09b-3831b5269357]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0ec9d4-11f9-4622-85f3-d9806531ace6]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[304cda77-f7a7-466d-9d99-61145d3c3ebb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe13f591-9a12-4638-987f-d6689a247933]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d888625-4d73-45de-892e-26229406e4f0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ccba48-25c3-4efb-95cb-5f700f68b011]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260]
Nov 14 16:09:44 user nova-compute[75097]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67, portal: 172.16.0.220,3260] successful.
Nov 14 16:09:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e87877-2380-48a3-894d-58955eca5e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f8a33e-8468-44ce-a313-a59465e1fa77]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== disconnect_volume: return (324ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:09:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:09:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:45 user nova-compute[75097]: DEBUG nova.objects.instance [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'flavor' on Instance uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:09:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-29224580-8098-470a-97e1-061667015857 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.990s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:09:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:09:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:01 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'flavor' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:02 user nova-compute[75097]: INFO nova.compute.manager [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Attaching volume 7c40ee51-599e-4517-adf0-048f12057641 to /dev/vdb
Nov 14 16:10:02 user nova-compute[75097]: DEBUG os_brick.utils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d912c03f-7f95-4947-91e1-68c86003429e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b86cc80-fa8d-4a72-b18e-5e35ce9f74c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ee2837-a5cf-499b-ac76-1d5ebf7ceb75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8ec095-2aec-4c11-8918-efb28903b62d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:10:02 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:10:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a40a08-0cf2-49f6-a45c-ae17a568b2ad]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG os_brick.utils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:02 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating existing volume attachment record: ccca8407-a6e8-408a-a2ec-d3e40883ca23 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:10:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:06 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:06 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:06 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6114cb-afad-44fd-9e33-b3e5c2c56091]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:10:06 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b4ac1-08a6-4d70-8ca7-dd64c0c05958]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641] added
Nov 14 16:10:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3157f1-f068-46e5-ba4c-b1f5dfa43e60]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ddf5f6-3793-40e0-8c24-1cb0a255f29d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRbpuELJ {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRbpuELJ" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8876bf-0259-49ae-ac00-1d31edf7a459]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRbpuELJ'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dd4035-a66b-4c6a-bbac-2889f0cc4364]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b94f331-5eab-4325-8137-7cabcb10809e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff30d3-ab42-4f02-9148-3ae8f09bc15f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]
Nov 14 16:10:06 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:06 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[032b5bbc-a0f1-4175-a4d7-81b6d7c06cad]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0938199-daff-44df-a67f-efbdf7abab9e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5246915-dc19-4022-9152-bbfca23da3aa]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:10:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23831376665666333', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831376665666333', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'flavor' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:10:08 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:10:08 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:10:08 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:10:08 user nova-compute[75097]:   <serial>7c40ee51-599e-4517-adf0-048f12057641</serial>
Nov 14 16:10:08 user nova-compute[75097]: </disk>
Nov 14 16:10:08 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No VIF found with MAC fa:16:3e:d1:b5:f0, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:10:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2a26e5db-8f6c-4451-a4ee-e348f46afff6 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.393s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing instance network info cache due to event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:10:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:10:12 user nova-compute[75097]: DEBUG nova.network.neutron [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updated VIF entry in instance network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:10:12 user nova-compute[75097]: DEBUG nova.network.neutron [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-59e6bae4-787c-4f8a-90e2-36f046b37100 req-425f4266-b2d5-4c23-bc1d-a82902671201 service nova] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:13 user nova-compute[75097]: INFO nova.compute.manager [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Detaching volume 2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:10:13 user nova-compute[75097]: INFO nova.virt.block_device [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Attempting to driver detach volume 2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 from mountpoint /dev/vdb
Nov 14 16:10:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Attempting to detach device vdb from instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:10:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:10:13 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:10:13 user nova-compute[75097]:   <source dev="/dev/sdf"/>
Nov 14 16:10:13 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:10:13 user nova-compute[75097]:   <serial>2ad2f20d-465e-4c0d-8f09-32e923ea1aa0</serial>
Nov 14 16:10:13 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:10:13 user nova-compute[75097]: </disk>
Nov 14 16:10:13 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:10:13 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully detached device vdb from instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe from the persistent domain config.
Nov 14 16:10:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:10:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:10:13 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:10:13 user nova-compute[75097]:   <source dev="/dev/sdf"/>
Nov 14 16:10:13 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:10:13 user nova-compute[75097]:   <serial>2ad2f20d-465e-4c0d-8f09-32e923ea1aa0</serial>
Nov 14 16:10:13 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:10:13 user nova-compute[75097]: </disk>
Nov 14 16:10:13 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:10:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:14 user nova-compute[75097]: INFO nova.compute.manager [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Terminating instance
Nov 14 16:10:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing instance network info cache due to event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updated VIF entry in instance network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-15b85d15-4c1d-4db5-8b97-a229fa42514d req-c8d38149-304f-48e8-a752-6e708cfdee6d service nova] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Instance destroyed successfully.
Nov 14 16:10:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'resources' on Instance uuid f4eb61fa-ad89-4fad-b649-869efa6043c0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1600934682',display_name='tempest-ServerActionsTestOtherA-server-262853361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1600934682',id=17,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpSXJJUSODFI4cAb2k9NEktgfAYWMb0LkasDxu0ebPJq3WK3O4/dIQAma25q1DmS8B+ZzHbyX8Dm37qKQvD1tndswkqegWiKxemgPlClz7T4zTEGctOcBZhCgUAj4Hjbg==',key_name='tempest-keypair-1661349674',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-ulnvtc04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=f4eb61fa-ad89-4fad-b649-869efa6043c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "address": "fa:16:3e:a8:3f:85", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f59ad-3b", "ovs_interfaceid": "942f59ad-3b4f-4545-ab74-de84dbf0e786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG os_vif [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap942f59ad-3b, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=525738b4-9275-43de-a2d2-c3bf598978e5) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:15 user nova-compute[75097]: INFO os_vif [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3f:85,bridge_name='br-int',has_traffic_filtering=True,id=942f59ad-3b4f-4545-ab74-de84dbf0e786,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f59ad-3b')
Nov 14 16:10:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Deleting instance files /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0_del
Nov 14 16:10:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Deletion of /opt/stack/data/nova/instances/f4eb61fa-ad89-4fad-b649-869efa6043c0_del complete
Nov 14 16:10:15 user nova-compute[75097]: INFO nova.compute.manager [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 16:10:15 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:10:15 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:16 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Took 1.05 seconds to deallocate network for instance.
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-b2a357aa-c249-4998-9d03-0d2fa7816a24 req-e52a02a2-02fb-41f6-a4e5-f1573453241e service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-deleted-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-unplugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-unplugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:16 user nova-compute[75097]: WARNING nova.compute.manager [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-unplugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state deleted and task_state None.
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] Acquiring lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] No waiting events found dispatching network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:16 user nova-compute[75097]: WARNING nova.compute.manager [req-11b4c38e-bd92-4bb2-86a1-e08e5254222e req-e2a2cff8-548f-48b0-bd99-3e079244cd31 service nova] [instance: f4eb61fa-ad89-4fad-b649-869efa6043c0] Received unexpected event network-vif-plugged-942f59ad-3b4f-4545-ab74-de84dbf0e786 for instance with vm_state deleted and task_state None.
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:16 user nova-compute[75097]: INFO nova.compute.manager [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Rebooting instance
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.network.neutron [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:16 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Deleted allocations for instance f4eb61fa-ad89-4fad-b649-869efa6043c0
Nov 14 16:10:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9fc4f44c-e956-4748-a0e2-5e0c81c05c52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "f4eb61fa-ad89-4fad-b649-869efa6043c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG nova.network.neutron [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance destroyed successfully.
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'resources' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-120930556',display_name='tempest-TestMinimumBasicScenario-server-120930556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-120930556',id=22,image_ref='dde149ce-fcc4-486a-a992-59b050089b91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3jBDAiF8kCAndilZ58Fs99JIfkE42J6F++n1FO3/O0tM2uNbRObIwQ2qLh02WXryHSD7wRS/gAjcahH75rfTvw3c2OF97XJ9va+szbkvd8N1XUkCpCvjT9T0yz5BC7Q==',key_name='tempest-TestMinimumBasicScenario-1286213988',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-9000gmu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dde149ce-fcc4-486a-a992-59b050089b91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:10:17Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=67309ef7-8e83-4074-9419-2b815f7319bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73faa98-1a, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11076499-b6b5-465e-b51e-be0b4f536062) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:18 user nova-compute[75097]: INFO os_vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a')
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:18 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc350c4-66cd-46aa-aec2-187db642d38d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:10:18 user nova-compute[75097]: No targets found.
Nov 14 16:10:18 user nova-compute[75097]: iSNS:
Nov 14 16:10:18 user nova-compute[75097]: No targets found.
Nov 14 16:10:18 user nova-compute[75097]: STATIC:
Nov 14 16:10:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:10:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:10:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:10:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:10:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641
Nov 14 16:10:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:18 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:10:18 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:18 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:18 user nova-compute[75097]: FIRMWARE:
Nov 14 16:10:18 user nova-compute[75097]: No targets found.
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:10:18 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:10:18 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e4b4e3-6de5-4a24-a5d8-66e4c75d8620]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb29d874-6000-4719-bb75-8982f50c9d6f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98585480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c63ba7e-65eb-431a-84e9-600419903385]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3acf93e-7f45-4157-8557-465cbbadb9f0]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579a6a9-dfe3-4002-9a76-d1ee35a7850a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[de424d08-fde4-43ea-86c4-7331c7c92efc]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.095s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f64ec1-748e-4cce-8234-f4042bfb9d35]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af1c9fc-657f-40d5-ae01-45572191eaf7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]
Nov 14 16:10:18 user nova-compute[75097]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d6713-ef66-48f2-817c-fdb9474baa29]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== disconnect_volume: return (393ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Start _get_guest_xml network_info=[{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dde149ce-fcc4-486a-a992-59b050089b91,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': 'dde149ce-fcc4-486a-a992-59b050089b91'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '67309ef7-8e83-4074-9419-2b815f7319bc', 'attached_at': '', 'detached_at': '', 'volume_id': '7c40ee51-599e-4517-adf0-048f12057641', 'serial': '7c40ee51-599e-4517-adf0-048f12057641'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'ccca8407-a6e8-408a-a2ec-d3e40883ca23', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:10:18 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:10:18 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dde149ce-fcc4-486a-a992-59b050089b91,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-unplugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-unplugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:18 user nova-compute[75097]: WARNING nova.compute.manager [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-unplugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:18 user nova-compute[75097]: WARNING nova.compute.manager [req-e6db42e7-4d28-48e5-99e3-aeeea888f017 req-fc9794d7-59e0-4edd-b3c7-c241d0000b74 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.objects.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Object Instance<67309ef7-8e83-4074-9419-2b815f7319bc> lazy-loaded attributes: resources,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:18 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:18 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:18 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1cccc6-4540-48a8-b876-60246e3d372c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:10:18 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b87ea1-c18d-41d0-8334-5f6250fdb657]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641] added
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f95ab21-630d-42ae-90c7-c31f79668380]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5d1128-83a9-4c27-a3a0-c14c9d748e9e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRbpuELJ {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRbpuELJ" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ebacd2-84b6-40a3-bbd5-930f0287e587]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRbpuELJ'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[307809f4-b85a-44c5-a0da-ed85b3eaa142]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd7efbd-16bf-48b2-b948-0bd3ed32f1e4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[906bd70c-a6f4-4af0-8bae-2e7451eba911]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]
Nov 14 16:10:18 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:18 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e617aba5-bcd6-4c60-b264-d09aac630e6e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[add405c9-47fb-4904-a732-0387f38bfb21]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:19 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f4de8e-981d-45d6-8147-1656cb722fe4]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:10:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23831376665666333', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831376665666333', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-120930556',display_name='tempest-TestMinimumBasicScenario-server-120930556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-120930556',id=22,image_ref='dde149ce-fcc4-486a-a992-59b050089b91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3jBDAiF8kCAndilZ58Fs99JIfkE42J6F++n1FO3/O0tM2uNbRObIwQ2qLh02WXryHSD7wRS/gAjcahH75rfTvw3c2OF97XJ9va+szbkvd8N1XUkCpCvjT9T0yz5BC7Q==',key_name='tempest-TestMinimumBasicScenario-1286213988',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-9000gmu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dde149ce-fcc4-486a-a992-59b050089b91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:10:17Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=67309ef7-8e83-4074-9419-2b815f7319bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'pci_devices' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.objects.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Object Instance<67309ef7-8e83-4074-9419-2b815f7319bc> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:10:20 user nova-compute[75097]:   <uuid>67309ef7-8e83-4074-9419-2b815f7319bc</uuid>
Nov 14 16:10:20 user nova-compute[75097]:   <name>instance-00000016</name>
Nov 14 16:10:20 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:10:20 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:10:20 user nova-compute[75097]:   <metadata>
Nov 14 16:10:20 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:10:20 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:10:20 user nova-compute[75097]:       <nova:name>tempest-TestMinimumBasicScenario-server-120930556</nova:name>
Nov 14 16:10:20 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:10:18</nova:creationTime>
Nov 14 16:10:20 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:10:20 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:10:20 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:10:20 user nova-compute[75097]:       <nova:owner>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:user uuid="664b6227948844139c66874de91fab7d">tempest-TestMinimumBasicScenario-359238341-project-member</nova:user>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:project uuid="91e9e2ab228546a3b3d0b34f27bb5677">tempest-TestMinimumBasicScenario-359238341</nova:project>
Nov 14 16:10:20 user nova-compute[75097]:       </nova:owner>
Nov 14 16:10:20 user nova-compute[75097]:       <nova:root type="image" uuid="dde149ce-fcc4-486a-a992-59b050089b91"/>
Nov 14 16:10:20 user nova-compute[75097]:       <nova:ports>
Nov 14 16:10:20 user nova-compute[75097]:         <nova:port uuid="b73faa98-1a48-4897-ae43-4ef1725547b2">
Nov 14 16:10:20 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:10:20 user nova-compute[75097]:         </nova:port>
Nov 14 16:10:20 user nova-compute[75097]:       </nova:ports>
Nov 14 16:10:20 user nova-compute[75097]:     </nova:instance>
Nov 14 16:10:20 user nova-compute[75097]:   </metadata>
Nov 14 16:10:20 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:10:20 user nova-compute[75097]:     <system>
Nov 14 16:10:20 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:10:20 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:10:20 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:10:20 user nova-compute[75097]:       <entry name="serial">67309ef7-8e83-4074-9419-2b815f7319bc</entry>
Nov 14 16:10:20 user nova-compute[75097]:       <entry name="uuid">67309ef7-8e83-4074-9419-2b815f7319bc</entry>
Nov 14 16:10:20 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:10:20 user nova-compute[75097]:     </system>
Nov 14 16:10:20 user nova-compute[75097]:   </sysinfo>
Nov 14 16:10:20 user nova-compute[75097]:   <os>
Nov 14 16:10:20 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:10:20 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:10:20 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:10:20 user nova-compute[75097]:   </os>
Nov 14 16:10:20 user nova-compute[75097]:   <features>
Nov 14 16:10:20 user nova-compute[75097]:     <acpi/>
Nov 14 16:10:20 user nova-compute[75097]:     <apic/>
Nov 14 16:10:20 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:10:20 user nova-compute[75097]:   </features>
Nov 14 16:10:20 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:10:20 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:10:20 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:10:20 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:10:20 user nova-compute[75097]:   </clock>
Nov 14 16:10:20 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:10:20 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:10:20 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:10:20 user nova-compute[75097]:   </cpu>
Nov 14 16:10:20 user nova-compute[75097]:   <devices>
Nov 14 16:10:20 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:10:20 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:10:20 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk"/>
Nov 14 16:10:20 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:10:20 user nova-compute[75097]:     </disk>
Nov 14 16:10:20 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:10:20 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:10:20 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:10:20 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:10:20 user nova-compute[75097]:       <serial>7c40ee51-599e-4517-adf0-048f12057641</serial>
Nov 14 16:10:20 user nova-compute[75097]:     </disk>
Nov 14 16:10:20 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:10:20 user nova-compute[75097]:       <mac address="fa:16:3e:d1:b5:f0"/>
Nov 14 16:10:20 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:10:20 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:10:20 user nova-compute[75097]:       <target dev="tapb73faa98-1a"/>
Nov 14 16:10:20 user nova-compute[75097]:     </interface>
Nov 14 16:10:20 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:10:20 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/console.log" append="off"/>
Nov 14 16:10:20 user nova-compute[75097]:     </serial>
Nov 14 16:10:20 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:10:20 user nova-compute[75097]:     <video>
Nov 14 16:10:20 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:10:20 user nova-compute[75097]:     </video>
Nov 14 16:10:20 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:10:20 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:10:20 user nova-compute[75097]:     </rng>
Nov 14 16:10:20 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:10:20 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:10:20 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:10:20 user nova-compute[75097]:     </memballoon>
Nov 14 16:10:20 user nova-compute[75097]:   </devices>
Nov 14 16:10:20 user nova-compute[75097]: </domain>
Nov 14 16:10:20 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.objects.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Object Instance<67309ef7-8e83-4074-9419-2b815f7319bc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Cannot resize image /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'migration_context' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.objects.base [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Object Instance<67309ef7-8e83-4074-9419-2b815f7319bc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-120930556',display_name='tempest-TestMinimumBasicScenario-server-120930556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-120930556',id=22,image_ref='dde149ce-fcc4-486a-a992-59b050089b91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3jBDAiF8kCAndilZ58Fs99JIfkE42J6F++n1FO3/O0tM2uNbRObIwQ2qLh02WXryHSD7wRS/gAjcahH75rfTvw3c2OF97XJ9va+szbkvd8N1XUkCpCvjT9T0yz5BC7Q==',key_name='tempest-TestMinimumBasicScenario-1286213988',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-9000gmu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dde149ce-fcc4-486a-a992-59b050089b91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:10:17Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=67309ef7-8e83-4074-9419-2b815f7319bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG os_vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ad36fdd-b5f7-5b37-be30-3a067f6eeed5', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73faa98-1a, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73faa98-1a, col_values=(('qos', UUID('59249605-ecb5-4429-9fcc-05a6a23bdedb')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73faa98-1a, col_values=(('external_ids', {'iface-id': 'b73faa98-1a48-4897-ae43-4ef1725547b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:b5:f0', 'vm-uuid': '67309ef7-8e83-4074-9419-2b815f7319bc'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:20 user nova-compute[75097]: INFO os_vif [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a')
Nov 14 16:10:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-942d875b-b897-4ace-b054-f5ba8df6eb5f req-c75a0ea3-3c62-4761-9d4e-dec1a66b1d3f service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-942d875b-b897-4ace-b054-f5ba8df6eb5f req-c75a0ea3-3c62-4761-9d4e-dec1a66b1d3f service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-942d875b-b897-4ace-b054-f5ba8df6eb5f req-c75a0ea3-3c62-4761-9d4e-dec1a66b1d3f service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-942d875b-b897-4ace-b054-f5ba8df6eb5f req-c75a0ea3-3c62-4761-9d4e-dec1a66b1d3f service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-942d875b-b897-4ace-b054-f5ba8df6eb5f req-c75a0ea3-3c62-4761-9d4e-dec1a66b1d3f service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:22 user nova-compute[75097]: WARNING nova.compute.manager [req-942d875b-b897-4ace-b054-f5ba8df6eb5f req-c75a0ea3-3c62-4761-9d4e-dec1a66b1d3f service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 16:10:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-282fecff-5012-447d-a790-221864bbb184 req-fd644140-416e-4e37-b682-6c42fc6137d9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-282fecff-5012-447d-a790-221864bbb184 req-fd644140-416e-4e37-b682-6c42fc6137d9 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-282fecff-5012-447d-a790-221864bbb184 req-fd644140-416e-4e37-b682-6c42fc6137d9 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-282fecff-5012-447d-a790-221864bbb184 req-fd644140-416e-4e37-b682-6c42fc6137d9 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-282fecff-5012-447d-a790-221864bbb184 req-fd644140-416e-4e37-b682-6c42fc6137d9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:24 user nova-compute[75097]: WARNING nova.compute.manager [req-282fecff-5012-447d-a790-221864bbb184 req-fd644140-416e-4e37-b682-6c42fc6137d9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 16:10:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:10:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance rebooted successfully.
Nov 14 16:10:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:10:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-32ea91b9-b75e-42ba-a8d9-e9bc4df8a367 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.056s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-changed-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing instance network info cache due to event network-changed-0daf8da2-fb3b-42e1-b54f-b593f9800ff1. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:10:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] Acquiring lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] Acquired lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Refreshing network info cache for port 0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:10:31 user nova-compute[75097]: INFO nova.compute.claims [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Claim successful on node user
Nov 14 16:10:31 user nova-compute[75097]: DEBUG nova.network.neutron [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updated VIF entry in instance network info cache for port 0daf8da2-fb3b-42e1-b54f-b593f9800ff1. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG nova.network.neutron [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-83adb6ca-352f-4ec9-ab88-8bde38ab9586 req-37759fc6-e869-4497-a12a-9c8a8e96712f service nova] Releasing lock "refresh_cache-c78c5ba9-5257-413d-b87c-7acb9506bbc1" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:10:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.policy [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bb999bbbcf4d4c9058ea6921655732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aefeb20cd07a41f09d0c4e19e99518f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:10:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Creating image(s)
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "/opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk 1073741824" returned: 0 in 0.059s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Successfully created port: 0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Cannot resize image /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Ensure instance console log exists: /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Successfully updated port: 0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-changed-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Refreshing instance network info cache due to event network-changed-0f080448-9ce2-4659-8d19-683e6eec2c53. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] Acquiring lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:10:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe is timed out.
Nov 14 16:10:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully detached device vdb from instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe from the live domain config.
Nov 14 16:10:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuOXCVwP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:33 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c99756-1606-4455-8c61-61f4d4df3f8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:10:33 user nova-compute[75097]: No targets found.
Nov 14 16:10:33 user nova-compute[75097]: iSNS:
Nov 14 16:10:33 user nova-compute[75097]: No targets found.
Nov 14 16:10:33 user nova-compute[75097]: STATIC:
Nov 14 16:10:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:10:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0
Nov 14 16:10:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:10:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:10:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641
Nov 14 16:10:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:10:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:33 user nova-compute[75097]: FIRMWARE:
Nov 14 16:10:33 user nova-compute[75097]: No targets found.
Nov 14 16:10:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:10:33 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:10:33 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:10:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e4626-3d5d-491d-aa31-2b09d9c7b5be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fc9190-049b-412f-8622-811f73d8d4cd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98760160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0'): ({'sdf'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Removing single pathed devices sdf {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef1430a-4606-455e-a410-21c65a2162d0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edfa736-d0df-415a-ad7d-c52e423af10c]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flushing IO for device /dev/sdf {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654efbd-a00a-48b7-b0dc-92bd9d1ef71b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: INFO nova.compute.manager [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Terminating instance
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2cbf0e-de7c-48d2-b63c-592c35c84e1c]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] SCSI volumes sdf have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50fdb3c-8fcc-4eef-aa9d-24106eb028f1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Instance network_info: |[{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] Acquired lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.network.neutron [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Refreshing network info cache for port 0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Start _get_guest_xml network_info=[{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:10:34 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-853240297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-853240297',id=25,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-ov4cnkg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:10:33Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=099ba580-8e81-42ac-864c-8a76a6b8f2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'pci_devices' on Instance uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e7eed-d735-4b4d-b86d-91a62ea318c1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260]
Nov 14 16:10:34 user nova-compute[75097]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:34 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:10:34 user nova-compute[75097]:   <uuid>099ba580-8e81-42ac-864c-8a76a6b8f2c5</uuid>
Nov 14 16:10:34 user nova-compute[75097]:   <name>instance-00000019</name>
Nov 14 16:10:34 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:10:34 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:10:34 user nova-compute[75097]:   <metadata>
Nov 14 16:10:34 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:10:34 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:10:34 user nova-compute[75097]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-853240297</nova:name>
Nov 14 16:10:34 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:10:34</nova:creationTime>
Nov 14 16:10:34 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:10:34 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:10:34 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:10:34 user nova-compute[75097]:       <nova:owner>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:user uuid="b4bb999bbbcf4d4c9058ea6921655732">tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member</nova:user>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:project uuid="aefeb20cd07a41f09d0c4e19e99518f0">tempest-ServerBootFromVolumeStableRescueTest-1745607452</nova:project>
Nov 14 16:10:34 user nova-compute[75097]:       </nova:owner>
Nov 14 16:10:34 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:10:34 user nova-compute[75097]:       <nova:ports>
Nov 14 16:10:34 user nova-compute[75097]:         <nova:port uuid="0f080448-9ce2-4659-8d19-683e6eec2c53">
Nov 14 16:10:34 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:10:34 user nova-compute[75097]:         </nova:port>
Nov 14 16:10:34 user nova-compute[75097]:       </nova:ports>
Nov 14 16:10:34 user nova-compute[75097]:     </nova:instance>
Nov 14 16:10:34 user nova-compute[75097]:   </metadata>
Nov 14 16:10:34 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:10:34 user nova-compute[75097]:     <system>
Nov 14 16:10:34 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:10:34 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:10:34 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:10:34 user nova-compute[75097]:       <entry name="serial">099ba580-8e81-42ac-864c-8a76a6b8f2c5</entry>
Nov 14 16:10:34 user nova-compute[75097]:       <entry name="uuid">099ba580-8e81-42ac-864c-8a76a6b8f2c5</entry>
Nov 14 16:10:34 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:10:34 user nova-compute[75097]:     </system>
Nov 14 16:10:34 user nova-compute[75097]:   </sysinfo>
Nov 14 16:10:34 user nova-compute[75097]:   <os>
Nov 14 16:10:34 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:10:34 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:10:34 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:10:34 user nova-compute[75097]:   </os>
Nov 14 16:10:34 user nova-compute[75097]:   <features>
Nov 14 16:10:34 user nova-compute[75097]:     <acpi/>
Nov 14 16:10:34 user nova-compute[75097]:     <apic/>
Nov 14 16:10:34 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:10:34 user nova-compute[75097]:   </features>
Nov 14 16:10:34 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:10:34 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:10:34 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:10:34 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:10:34 user nova-compute[75097]:   </clock>
Nov 14 16:10:34 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:10:34 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:10:34 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:10:34 user nova-compute[75097]:   </cpu>
Nov 14 16:10:34 user nova-compute[75097]:   <devices>
Nov 14 16:10:34 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:10:34 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:10:34 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk"/>
Nov 14 16:10:34 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:10:34 user nova-compute[75097]:     </disk>
Nov 14 16:10:34 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:10:34 user nova-compute[75097]:       <mac address="fa:16:3e:ad:7b:5b"/>
Nov 14 16:10:34 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:10:34 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:10:34 user nova-compute[75097]:       <target dev="tap0f080448-9c"/>
Nov 14 16:10:34 user nova-compute[75097]:     </interface>
Nov 14 16:10:34 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:10:34 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/console.log" append="off"/>
Nov 14 16:10:34 user nova-compute[75097]:     </serial>
Nov 14 16:10:34 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:10:34 user nova-compute[75097]:     <video>
Nov 14 16:10:34 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:10:34 user nova-compute[75097]:     </video>
Nov 14 16:10:34 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:10:34 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:10:34 user nova-compute[75097]:     </rng>
Nov 14 16:10:34 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:10:34 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:10:34 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:10:34 user nova-compute[75097]:     </memballoon>
Nov 14 16:10:34 user nova-compute[75097]:   </devices>
Nov 14 16:10:34 user nova-compute[75097]: </domain>
Nov 14 16:10:34 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-853240297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-853240297',id=25,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-ov4cnkg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:10:33Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=099ba580-8e81-42ac-864c-8a76a6b8f2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_vif [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3a3d4d2-f56b-5c69-bbe7-e70cd8befa01', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ad2f20d-465e-4c0d-8f09-32e923ea1aa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a8ba56-5e23-486c-9bf8-8b1e11d593da]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== disconnect_volume: return (467ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f080448-9c, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f080448-9c, col_values=(('qos', UUID('049509fa-a8a4-4f17-9120-ff59bfd0a2b3')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f080448-9c, col_values=(('external_ids', {'iface-id': '0f080448-9ce2-4659-8d19-683e6eec2c53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:7b:5b', 'vm-uuid': '099ba580-8e81-42ac-864c-8a76a6b8f2c5'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: INFO os_vif [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c')
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No VIF found with MAC fa:16:3e:ad:7b:5b, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-4e6f4980-5828-42e8-93ba-b04eccd784d6 req-9128a58c-5c6c-44cf-aaa8-063951baa2c2 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4e6f4980-5828-42e8-93ba-b04eccd784d6 req-9128a58c-5c6c-44cf-aaa8-063951baa2c2 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4e6f4980-5828-42e8-93ba-b04eccd784d6 req-9128a58c-5c6c-44cf-aaa8-063951baa2c2 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4e6f4980-5828-42e8-93ba-b04eccd784d6 req-9128a58c-5c6c-44cf-aaa8-063951baa2c2 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-4e6f4980-5828-42e8-93ba-b04eccd784d6 req-9128a58c-5c6c-44cf-aaa8-063951baa2c2 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-4e6f4980-5828-42e8-93ba-b04eccd784d6 req-9128a58c-5c6c-44cf-aaa8-063951baa2c2 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-b7859dba-f9c6-4972-afab-efc7e28261df for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.network.neutron [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updated VIF entry in instance network info cache for port 0f080448-9ce2-4659-8d19-683e6eec2c53. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.network.neutron [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-613dcdb4-08b1-4c54-acbc-472290826493 req-0e0bf6ce-ed1b-4074-a9f6-e2a278532396 service nova] Releasing lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-f17bd199-f7e8-4d92-9611-236f5d32cc78 req-567a2557-208b-4db3-9064-2fe7091f1bfa service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f17bd199-f7e8-4d92-9611-236f5d32cc78 req-567a2557-208b-4db3-9064-2fe7091f1bfa service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f17bd199-f7e8-4d92-9611-236f5d32cc78 req-567a2557-208b-4db3-9064-2fe7091f1bfa service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f17bd199-f7e8-4d92-9611-236f5d32cc78 req-567a2557-208b-4db3-9064-2fe7091f1bfa service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-f17bd199-f7e8-4d92-9611-236f5d32cc78 req-567a2557-208b-4db3-9064-2fe7091f1bfa service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-f17bd199-f7e8-4d92-9611-236f5d32cc78 req-567a2557-208b-4db3-9064-2fe7091f1bfa service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.objects.instance [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53fcb7b0-b9d7-4812-9520-1bd53a3b3912 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.448s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:35 user nova-compute[75097]: WARNING nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 for instance with vm_state active and task_state deleting.
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:35 user nova-compute[75097]: WARNING nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-15cf14e1-98b3-4c5b-83fa-6412a6777c3a for instance with vm_state active and task_state deleting.
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-baa75379-46df-49cd-a1b8-028fe77051d0 req-fef92b9a-f4ee-4056-9f91-fdcc23cc8af9 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Instance destroyed successfully.
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.objects.instance [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lazy-loading 'resources' on Instance uuid c78c5ba9-5257-413d-b87c-7acb9506bbc1 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "address": "fa:16:3e:c1:bc:ad", "network": {"id": "4a25502c-03bb-4983-a597-879c758475bb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-288778795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0daf8da2-fb", "ovs_interfaceid": "0daf8da2-fb3b-42e1-b54f-b593f9800ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0daf8da2-fb, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39c07509-aada-49ed-93c3-8b4d5a4add87) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bc:ad,bridge_name='br-int',has_traffic_filtering=True,id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1,network=Network(4a25502c-03bb-4983-a597-879c758475bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0daf8da2-fb')
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7859dba-f9, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:36 user nova-compute[75097]: WARNING nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-b7859dba-f9c6-4972-afab-efc7e28261df for instance with vm_state active and task_state deleting.
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:36 user nova-compute[75097]: WARNING nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 for instance with vm_state active and task_state deleting.
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-unplugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-unplugged-36048eab-4d91-42dc-942f-384bcacf1c56 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:36 user nova-compute[75097]: WARNING nova.compute.manager [req-bf5e57b6-a87d-4343-a043-cf7e0e1dae1d req-0a9b38a3-ce40-4381-9502-348b9e762745 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-36048eab-4d91-42dc-942f-384bcacf1c56 for instance with vm_state active and task_state deleting.
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c44ca2ae-99b6-49ba-a842-0636e543ba0d) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:35:01,bridge_name='br-int',has_traffic_filtering=True,id=b7859dba-f9c6-4972-afab-efc7e28261df,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7859dba-f9')
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15cf14e1-98, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00c1401a-0cb5-4631-9eb7-85eab56618b2) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:77,bridge_name='br-int',has_traffic_filtering=True,id=15cf14e1-98b3-4c5b-83fa-6412a6777c3a,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15cf14e1-98')
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97c5a7c4-b4, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-1fed297f-820d-48d5-986f-a56dbc3525b7 req-53d872b8-cb4c-427b-8eef-84113a521b61 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1fed297f-820d-48d5-986f-a56dbc3525b7 req-53d872b8-cb4c-427b-8eef-84113a521b61 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1fed297f-820d-48d5-986f-a56dbc3525b7 req-53d872b8-cb4c-427b-8eef-84113a521b61 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1fed297f-820d-48d5-986f-a56dbc3525b7 req-53d872b8-cb4c-427b-8eef-84113a521b61 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-1fed297f-820d-48d5-986f-a56dbc3525b7 req-53d872b8-cb4c-427b-8eef-84113a521b61 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:37 user nova-compute[75097]: WARNING nova.compute.manager [req-1fed297f-820d-48d5-986f-a56dbc3525b7 req-53d872b8-cb4c-427b-8eef-84113a521b61 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 for instance with vm_state active and task_state deleting.
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=355f012c-8b58-46f0-b8ad-6d239ccf8b89) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:9a:4b,bridge_name='br-int',has_traffic_filtering=True,id=97c5a7c4-b47e-4e39-a2b1-dcdcbe696241,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c5a7c4-b4')
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36048eab-4d, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a11385f9-2384-4f96-a96a-3fc1f5236291) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=36048eab-4d91-42dc-942f-384bcacf1c56,network=Network(6e40ef26-63da-48f4-a0c2-ab54c86ba7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36048eab-4d')
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1ecd972-5d, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df3e2170-905e-4585-9a87-558ea3966cf4) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:e7:05,bridge_name='br-int',has_traffic_filtering=True,id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecd972-5d')
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T16:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733476865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733476865',id=23,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHaPoqFQNwkKI4gaMcQ0gsv136Wv8KVXmoJiPW8bV0LoVEQ4PZgdtojR9ZGvJLUiov0NgOX0wWmLrti7TM/WR6w+jB6Urr8oaUyv38xCjyZbJMDmNEUtIBPR7ZhGZKtzA==',key_name='tempest-keypair-1545223631',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3400d5c07e4345d091d85c696a1914c2',ramdisk_id='',reservation_id='r-0squygdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2001721703',owner_user_name='tempest-TaggedBootDevicesTest_v242-2001721703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cc6e8e3ae26426f8888d88d1c064e3a',uuid=c78c5ba9-5257-413d-b87c-7acb9506bbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converting VIF {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b592e2d-96, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55de6530-9f01-4be7-8ade-4f337237fea5) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:37 user nova-compute[75097]: INFO os_vif [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=4b592e2d-96d0-4ae0-9690-f8a36d529dac,network=Network(cd99f875-2e5d-44ff-9b01-a04806d29a60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b592e2d-96')
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzaTXWiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:37 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4472790-bd97-48c9-b269-1c7e2ac74378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:10:37 user nova-compute[75097]: No targets found.
Nov 14 16:10:37 user nova-compute[75097]: iSNS:
Nov 14 16:10:37 user nova-compute[75097]: No targets found.
Nov 14 16:10:37 user nova-compute[75097]: STATIC:
Nov 14 16:10:37 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:10:37 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:37 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:37 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:10:37 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:37 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:37 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:10:37 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:37 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:37 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641
Nov 14 16:10:37 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:37 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:37 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:10:37 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:37 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:37 user nova-compute[75097]: FIRMWARE:
Nov 14 16:10:37 user nova-compute[75097]: No targets found.
Nov 14 16:10:37 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:10:37 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:10:37 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b11742-db80-4e09-a538-09360b1919b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0980f8-ad78-475a-96e2-9f4a6e7dae96]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:37 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafb8144040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[18256092-cb6c-45f9-bf55-f59f2fd7e461]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f721b2-9131-44d8-bef2-171fe0567a86]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0bd498-c71a-4895-9395-2105ef250278]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[046da31d-8396-474f-a4f6-75a4d456c5e2]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Acquiring lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] No waiting events found dispatching network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:38 user nova-compute[75097]: WARNING nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received unexpected event network-vif-plugged-4b592e2d-96d0-4ae0-9690-f8a36d529dac for instance with vm_state active and task_state deleting.
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] No waiting events found dispatching network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:38 user nova-compute[75097]: WARNING nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received unexpected event network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 for instance with vm_state building and task_state spawning.
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] No waiting events found dispatching network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:10:38 user nova-compute[75097]: WARNING nova.compute.manager [req-c33795a2-8f1a-45c8-b38f-cb1e24f33fdb req-6da6d421-9ba4-4664-af25-fd8e4b2dd3a7 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received unexpected event network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 for instance with vm_state building and task_state spawning.
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a7e6ef-6253-470c-b515-ac755e199806]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[813f7d10-e07c-460d-bf02-9b7d659c6d24]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260]
Nov 14 16:10:38 user nova-compute[75097]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3086622a-b4b7-4149-84bb-d0bb222e0641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6062b46b-7351-44b1-815e-3b54c769a3bc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== disconnect_volume: return (376ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvxAFHpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:38 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f68e7a-acae-4f3c-8ba7-2081ee0e691f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:10:38 user nova-compute[75097]: No targets found.
Nov 14 16:10:38 user nova-compute[75097]: iSNS:
Nov 14 16:10:38 user nova-compute[75097]: No targets found.
Nov 14 16:10:38 user nova-compute[75097]: STATIC:
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: FIRMWARE:
Nov 14 16:10:38 user nova-compute[75097]: No targets found.
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:10:38 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:10:38 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ac08f-c53e-4910-a4a0-64d049f54dca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[794fca6d-87f9-4108-9683-0b3526b1958e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf986e4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81'): ({'sdg'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Removing single pathed devices sdg {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ca28a-1418-41f4-b286-c305ebd87d6b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687da1b-eada-4ca3-bf7b-a09094e340c5]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Flushing IO for device /dev/sdg {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db25c72-5a81-4d27-acab-0b52c917febf]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ce53f-297b-4589-bb2c-7aee3e31731c]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] SCSI volumes sdg have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec703c2c-caba-404e-94ce-28f01c5681dc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311d611-ec88-42e0-a09c-95eea7de0649]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260]
Nov 14 16:10:38 user nova-compute[75097]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c35df249-9f2c-4a17-9a15-d13e8d3aeb81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f5b5f-0b4f-4eb7-851d-c05280332f4c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== disconnect_volume: return (319ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpOGjDXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:10:38 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a9f424-51c6-41e3-a6c6-ee414a1a3149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:10:38 user nova-compute[75097]: No targets found.
Nov 14 16:10:38 user nova-compute[75097]: iSNS:
Nov 14 16:10:38 user nova-compute[75097]: No targets found.
Nov 14 16:10:38 user nova-compute[75097]: STATIC:
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:10:38 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:10:38 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:10:38 user nova-compute[75097]: FIRMWARE:
Nov 14 16:10:38 user nova-compute[75097]: No targets found.
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:10:38 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:10:38 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[39124f98-81a8-4327-80be-4e61d0997415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1388535b-edcc-4699-adc3-c17fdb704ed5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf984a9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3'): ({'sdh'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Removing single pathed devices sdh {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c858bee-639c-4562-a22e-103f7b1cf7c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e111e17-b5e4-4e19-aceb-52946eb1aec1]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Flushing IO for device /dev/sdh {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3f273f-9228-4d4e-8eb5-5f1fffc7cae5]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2162e0f1-60f9-44ea-8142-96561cbf72a5]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] SCSI volumes sdh have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[56072b76-47f8-40c6-b5b4-6a9d0f207c25]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd54e114-9e3e-4723-bac8-55ba6f1d801f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260]
Nov 14 16:10:38 user nova-compute[75097]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3, portal: 172.16.0.220,3260] successful.
Nov 14 16:10:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6d8031d-f2e9-4a14-b087-ae61747d86c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2f4c7-9c05-44dc-90cf-5b2a4806fe27]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] <== disconnect_volume: return (352ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:10:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Deleting instance files /opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1_del
Nov 14 16:10:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Deletion of /opt/stack/data/nova/instances/c78c5ba9-5257-413d-b87c-7acb9506bbc1_del complete
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:38 user nova-compute[75097]: INFO nova.compute.manager [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Took 4.74 seconds to destroy the instance on the hypervisor.
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:10:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Instance spawned successfully.
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:39 user nova-compute[75097]: INFO nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:39 user nova-compute[75097]: INFO nova.compute.manager [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Took 8.17 seconds to build instance.
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eb2ced7e-39f9-416c-aaf1-cb877708bc81 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.296s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:10:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-2f9f8640-4968-481f-9e57-3f29416c0f53 req-f86f10b2-daad-4a76-99be-d5602358c86a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-deleted-0daf8da2-fb3b-42e1-b54f-b593f9800ff1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:41 user nova-compute[75097]: INFO nova.compute.manager [req-2f9f8640-4968-481f-9e57-3f29416c0f53 req-f86f10b2-daad-4a76-99be-d5602358c86a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Neutron deleted interface 0daf8da2-fb3b-42e1-b54f-b593f9800ff1; detaching it from the instance and deleting it from the info cache
Nov 14 16:10:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-2f9f8640-4968-481f-9e57-3f29416c0f53 req-f86f10b2-daad-4a76-99be-d5602358c86a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "address": "fa:16:3e:11:e7:05", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecd972-5d", "ovs_interfaceid": "b1ecd972-5d6c-4491-ba6c-7c9828bc3867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-2f9f8640-4968-481f-9e57-3f29416c0f53 req-f86f10b2-daad-4a76-99be-d5602358c86a service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Detach interface failed, port_id=0daf8da2-fb3b-42e1-b54f-b593f9800ff1, reason: Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.283s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:10:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:10:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid 'c78c5ba9-5257-413d-b87c-7acb9506bbc1' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c78c5ba9-5257-413d-b87c-7acb9506bbc1' (instance-00000017)
Nov 14 16:10:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:10:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=25.292396545410156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 67309ef7-8e83-4074-9419-2b815f7319bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 44342db6-8756-46db-a279-0557c24e5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 17946bc0-ba29-42a0-8993-74699b98d836 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:10:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-deleted-b1ecd972-5d6c-4491-ba6c-7c9828bc3867 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:43 user nova-compute[75097]: INFO nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Neutron deleted interface b1ecd972-5d6c-4491-ba6c-7c9828bc3867; detaching it from the instance and deleting it from the info cache
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36048eab-4d91-42dc-942f-384bcacf1c56", "address": "fa:16:3e:cb:21:bf", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36048eab-4d", "ovs_interfaceid": "36048eab-4d91-42dc-942f-384bcacf1c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Detach interface failed, port_id=b1ecd972-5d6c-4491-ba6c-7c9828bc3867, reason: Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-deleted-36048eab-4d91-42dc-942f-384bcacf1c56 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:43 user nova-compute[75097]: INFO nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Neutron deleted interface 36048eab-4d91-42dc-942f-384bcacf1c56; detaching it from the instance and deleting it from the info cache
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "address": "fa:16:3e:86:8a:3c", "network": {"id": "cd99f875-2e5d-44ff-9b01-a04806d29a60", "bridge": "br-int", "label": "tempest-device-tagging-net2-874799134", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b592e2d-96", "ovs_interfaceid": "4b592e2d-96d0-4ae0-9690-f8a36d529dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Detach interface failed, port_id=36048eab-4d91-42dc-942f-384bcacf1c56, reason: Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-deleted-4b592e2d-96d0-4ae0-9690-f8a36d529dac {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:43 user nova-compute[75097]: INFO nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Neutron deleted interface 4b592e2d-96d0-4ae0-9690-f8a36d529dac; detaching it from the instance and deleting it from the info cache
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [{"id": "b7859dba-f9c6-4972-afab-efc7e28261df", "address": "fa:16:3e:82:35:01", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7859dba-f9", "ovs_interfaceid": "b7859dba-f9c6-4972-afab-efc7e28261df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "address": "fa:16:3e:dc:86:77", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf14e1-98", "ovs_interfaceid": "15cf14e1-98b3-4c5b-83fa-6412a6777c3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "address": "fa:16:3e:39:9a:4b", "network": {"id": "6e40ef26-63da-48f4-a0c2-ab54c86ba7c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-702865499", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3400d5c07e4345d091d85c696a1914c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c5a7c4-b4", "ovs_interfaceid": "97c5a7c4-b47e-4e39-a2b1-dcdcbe696241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-902f99a6-3159-4c31-8bd1-161196fb81dd req-3049fbfc-27be-41bd-9cfb-68b0d3fc7001 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Detach interface failed, port_id=4b592e2d-96d0-4ae0-9690-f8a36d529dac, reason: Instance c78c5ba9-5257-413d-b87c-7acb9506bbc1 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:10:43 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:43 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Took 4.62 seconds to deallocate network for instance.
Nov 14 16:10:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:10:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-3916e9f2-5100-4985-a87f-74524899fb92 req-eb2801df-b525-4377-b9af-ec984b896797 service nova] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Received event network-vif-deleted-97c5a7c4-b47e-4e39-a2b1-dcdcbe696241 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:45 user nova-compute[75097]: INFO nova.compute.manager [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] [instance: c78c5ba9-5257-413d-b87c-7acb9506bbc1] Took 2.37 seconds to detach 3 volumes for instance.
Nov 14 16:10:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:46 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Deleted allocations for instance c78c5ba9-5257-413d-b87c-7acb9506bbc1
Nov 14 16:10:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-022fac2a-b457-4b0d-b533-5af331f19094 tempest-TaggedBootDevicesTest_v242-2001721703 tempest-TaggedBootDevicesTest_v242-2001721703-project-member] Lock "c78c5ba9-5257-413d-b87c-7acb9506bbc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.290s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:10:46 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:10:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:10:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing instance network info cache due to event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'flavor' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:10:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:00 user nova-compute[75097]: INFO nova.compute.manager [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Attaching volume 1ea81709-5009-4081-be2d-0bdd7deff913 to /dev/vdb
Nov 14 16:11:00 user nova-compute[75097]: DEBUG nova.network.neutron [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updated VIF entry in instance network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG nova.network.neutron [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bd827faa-8f2d-48c7-b3ce-c375264b571a req-109c7800-0b4e-4afb-9666-92436a4b3db4 service nova] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG os_brick.utils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2257d43d-2609-4fdc-ae29-6fc0d9a2df07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc530fd5-2332-43e1-9218-cff2be0ecca1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ebfe75-7fcc-4e4a-af23-06746f53c598]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb1cd1-b80f-489c-a29e-e446a4ef077a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:11:00 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:11:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f35965-a31b-4f2d-8d40-7f10a2214b4c]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG os_brick.utils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:11:00 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating existing volume attachment record: 7a86dd9b-0922-41db-87b7-bfe4f6690bb3 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:11:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:03 user nova-compute[75097]: INFO nova.compute.manager [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Terminating instance
Nov 14 16:11:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b13c271-d584-4fa9-8d71-7b61efa49584 req-e1e812f5-4f54-4f16-9cd8-d3a5801eeeea service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-vif-unplugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b13c271-d584-4fa9-8d71-7b61efa49584 req-e1e812f5-4f54-4f16-9cd8-d3a5801eeeea service nova] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b13c271-d584-4fa9-8d71-7b61efa49584 req-e1e812f5-4f54-4f16-9cd8-d3a5801eeeea service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b13c271-d584-4fa9-8d71-7b61efa49584 req-e1e812f5-4f54-4f16-9cd8-d3a5801eeeea service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b13c271-d584-4fa9-8d71-7b61efa49584 req-e1e812f5-4f54-4f16-9cd8-d3a5801eeeea service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] No waiting events found dispatching network-vif-unplugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b13c271-d584-4fa9-8d71-7b61efa49584 req-e1e812f5-4f54-4f16-9cd8-d3a5801eeeea service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-vif-unplugged-19bce176-4dc2-41e0-960d-2a4bb314862f for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:11:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Instance destroyed successfully.
Nov 14 16:11:04 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'resources' on Instance uuid 343d4aa5-7639-48bd-be32-92cc8d0b57fe {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2139499498',display_name='tempest-AttachVolumeNegativeTest-server-2139499498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2139499498',id=18,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl62C/jygZkQlX9gJTgu0T4lpVlZU+l+cNwDuM91QnyO+xxCmP4fgxFInLBwMtLnQpoguFpmZNatcsF8WWeY3NcZbGblCEw5Mtn4X6WA/INBYrx9bjEmyYnNA07Mq0uXw==',key_name='tempest-keypair-106254152',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-p3y5oakz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:05:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=343d4aa5-7639-48bd-be32-92cc8d0b57fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "19bce176-4dc2-41e0-960d-2a4bb314862f", "address": "fa:16:3e:a0:1e:06", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bce176-4d", "ovs_interfaceid": "19bce176-4dc2-41e0-960d-2a4bb314862f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG os_vif [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19bce176-4d, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59ea1a0c-225a-43c1-9baf-6fb30da913ea) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:04 user nova-compute[75097]: INFO os_vif [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=19bce176-4dc2-41e0-960d-2a4bb314862f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bce176-4d')
Nov 14 16:11:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Deleting instance files /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe_del
Nov 14 16:11:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Deletion of /opt/stack/data/nova/instances/343d4aa5-7639-48bd-be32-92cc8d0b57fe_del complete
Nov 14 16:11:04 user nova-compute[75097]: INFO nova.compute.manager [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 16:11:04 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:11:04 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWSXNlGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:11:05 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:11:05 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:11:05 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[35545ac6-65b2-4202-abd2-c89eeccc93a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:11:05 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae0fd0-8ab3-4ba3-b622-a9f81453704e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913] added
Nov 14 16:11:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[868e8ca6-b216-4fb6-80da-0fd52c63740c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48498030-fab4-4b88-936e-5bbe6947f707]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BWSXNlGU {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BWSXNlGU" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfeb4fa-262a-48a7-bd25-d90c4d6dac84]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BWSXNlGU'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a60868-33af-40c3-9b71-cfaa85a5abc9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddec40e-2eb5-40cb-b6c9-a424e9f62a11]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:11:05 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Took 0.79 seconds to deallocate network for instance.
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb92d8c-9361-48ea-9fcf-e681c4b92415]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260]
Nov 14 16:11:05 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260] successful.
Nov 14 16:11:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fdd6e1-c78e-45b0-8291-89751cb988d2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a119eedf-5cae-40db-9e13-57dd15043b06]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:11:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c25379-e7fa-4d99-97e5-69a573627191]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:05 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Deleted allocations for instance 343d4aa5-7639-48bd-be32-92cc8d0b57fe
Nov 14 16:11:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c315e39c-e23c-450d-9f68-aa80ab73c5ff tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] Acquiring lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] Lock "343d4aa5-7639-48bd-be32-92cc8d0b57fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] No waiting events found dispatching network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:06 user nova-compute[75097]: WARNING nova.compute.manager [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received unexpected event network-vif-plugged-19bce176-4dc2-41e0-960d-2a4bb314862f for instance with vm_state deleted and task_state None.
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-51ea00b0-98db-413f-9951-8ba8df41e4bb req-8193d6ca-040f-4048-be03-c50de8fa6241 service nova] [instance: 343d4aa5-7639-48bd-be32-92cc8d0b57fe] Received event network-vif-deleted-19bce176-4dc2-41e0-960d-2a4bb314862f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWSXNlGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23065356536353461', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065356536353461', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'flavor' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:11:06 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:11:06 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:11:06 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:11:06 user nova-compute[75097]:   <serial>1ea81709-5009-4081-be2d-0bdd7deff913</serial>
Nov 14 16:11:06 user nova-compute[75097]: </disk>
Nov 14 16:11:06 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:11:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:6d:ff:4d, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:11:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8365cdf5-acc7-4a2e-85fe-56f707e80a4d tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.919s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:07 user nova-compute[75097]: INFO nova.compute.manager [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Rescuing
Nov 14 16:11:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:11:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:11:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG nova.network.neutron [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-391fee7d-c8c4-435f-ac0e-490644513552 req-43ca2605-0868-44f5-b95d-38d48ee3e209 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-391fee7d-c8c4-435f-ac0e-490644513552 req-43ca2605-0868-44f5-b95d-38d48ee3e209 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-391fee7d-c8c4-435f-ac0e-490644513552 req-43ca2605-0868-44f5-b95d-38d48ee3e209 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-391fee7d-c8c4-435f-ac0e-490644513552 req-43ca2605-0868-44f5-b95d-38d48ee3e209 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-391fee7d-c8c4-435f-ac0e-490644513552 req-43ca2605-0868-44f5-b95d-38d48ee3e209 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:08 user nova-compute[75097]: WARNING nova.compute.manager [req-391fee7d-c8c4-435f-ac0e-490644513552 req-43ca2605-0868-44f5-b95d-38d48ee3e209 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance destroyed successfully.
Nov 14 16:11:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Attempting rescue
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75097) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:11:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Creating image(s)
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue" returned: 0 in 0.061s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'migration_context' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.base [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<44342db6-8756-46db-a279-0557c24e5d2d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Start _get_guest_xml network_info=[{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:6d:ff:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8453bef7-6457-4331-abaa-62588e201fe1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'resources' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.base [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<44342db6-8756-46db-a279-0557c24e5d2d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'numa_topology' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.base [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<44342db6-8756-46db-a279-0557c24e5d2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:11:09 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:11:09 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.base [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<44342db6-8756-46db-a279-0557c24e5d2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1796443693',display_name='tempest-ServerRescueNegativeTestJSON-server-1796443693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1796443693',id=24,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44dvZEELnb9RBytVGxDZvUPg76aN5i6tmwXWvRLUdI4cvikCU64842EES4HipdVTEqUy9GdUaB2rD/dqtGhF5f1kq4ZRAvnlrXclgvtE2WKLELATAZ+AL5UNWlJ9Q2KQ==',key_name='tempest-keypair-2030503793',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-gvdr15to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=44342db6-8756-46db-a279-0557c24e5d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:6d:ff:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "vif_mac": "fa:16:3e:6d:ff:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'pci_devices' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.objects.base [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Object Instance<44342db6-8756-46db-a279-0557c24e5d2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:11:09 user nova-compute[75097]:   <uuid>44342db6-8756-46db-a279-0557c24e5d2d</uuid>
Nov 14 16:11:09 user nova-compute[75097]:   <name>instance-00000018</name>
Nov 14 16:11:09 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:11:09 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:11:09 user nova-compute[75097]:   <metadata>
Nov 14 16:11:09 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:11:09 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:11:09 user nova-compute[75097]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1796443693</nova:name>
Nov 14 16:11:09 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:11:09</nova:creationTime>
Nov 14 16:11:09 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:11:09 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:11:09 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:11:09 user nova-compute[75097]:       <nova:owner>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:user uuid="a0d1946be4a442eb9b3bc8343510f656">tempest-ServerRescueNegativeTestJSON-2084860496-project-member</nova:user>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:project uuid="826e20e537274874bd3e0236eca9629f">tempest-ServerRescueNegativeTestJSON-2084860496</nova:project>
Nov 14 16:11:09 user nova-compute[75097]:       </nova:owner>
Nov 14 16:11:09 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:11:09 user nova-compute[75097]:       <nova:ports>
Nov 14 16:11:09 user nova-compute[75097]:         <nova:port uuid="dbed1766-e24b-471a-9559-c738f87ed9cb">
Nov 14 16:11:09 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 16:11:09 user nova-compute[75097]:         </nova:port>
Nov 14 16:11:09 user nova-compute[75097]:       </nova:ports>
Nov 14 16:11:09 user nova-compute[75097]:     </nova:instance>
Nov 14 16:11:09 user nova-compute[75097]:   </metadata>
Nov 14 16:11:09 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:11:09 user nova-compute[75097]:     <system>
Nov 14 16:11:09 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:11:09 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:11:09 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:11:09 user nova-compute[75097]:       <entry name="serial">44342db6-8756-46db-a279-0557c24e5d2d</entry>
Nov 14 16:11:09 user nova-compute[75097]:       <entry name="uuid">44342db6-8756-46db-a279-0557c24e5d2d</entry>
Nov 14 16:11:09 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:11:09 user nova-compute[75097]:     </system>
Nov 14 16:11:09 user nova-compute[75097]:   </sysinfo>
Nov 14 16:11:09 user nova-compute[75097]:   <os>
Nov 14 16:11:09 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:11:09 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:11:09 user nova-compute[75097]:   </os>
Nov 14 16:11:09 user nova-compute[75097]:   <features>
Nov 14 16:11:09 user nova-compute[75097]:     <acpi/>
Nov 14 16:11:09 user nova-compute[75097]:     <apic/>
Nov 14 16:11:09 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:11:09 user nova-compute[75097]:   </features>
Nov 14 16:11:09 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:11:09 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:11:09 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:11:09 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:11:09 user nova-compute[75097]:   </clock>
Nov 14 16:11:09 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:11:09 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:11:09 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:11:09 user nova-compute[75097]:   </cpu>
Nov 14 16:11:09 user nova-compute[75097]:   <devices>
Nov 14 16:11:09 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:11:09 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:11:09 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue"/>
Nov 14 16:11:09 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:11:09 user nova-compute[75097]:     </disk>
Nov 14 16:11:09 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:11:09 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:11:09 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk"/>
Nov 14 16:11:09 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:11:09 user nova-compute[75097]:     </disk>
Nov 14 16:11:09 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:11:09 user nova-compute[75097]:       <mac address="fa:16:3e:6d:ff:4d"/>
Nov 14 16:11:09 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:11:09 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:11:09 user nova-compute[75097]:       <target dev="tapdbed1766-e2"/>
Nov 14 16:11:09 user nova-compute[75097]:     </interface>
Nov 14 16:11:09 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:11:09 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/console.log" append="off"/>
Nov 14 16:11:09 user nova-compute[75097]:     </serial>
Nov 14 16:11:09 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:11:09 user nova-compute[75097]:     <video>
Nov 14 16:11:09 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:11:09 user nova-compute[75097]:     </video>
Nov 14 16:11:09 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:11:09 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:11:09 user nova-compute[75097]:     </rng>
Nov 14 16:11:09 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:11:09 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:11:09 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:11:09 user nova-compute[75097]:     </memballoon>
Nov 14 16:11:09 user nova-compute[75097]:   </devices>
Nov 14 16:11:09 user nova-compute[75097]: </domain>
Nov 14 16:11:09 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance destroyed successfully.
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:11:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] No VIF found with MAC fa:16:3e:6d:ff:4d, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:10 user nova-compute[75097]: WARNING nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:10 user nova-compute[75097]: WARNING nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:10 user nova-compute[75097]: WARNING nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:10 user nova-compute[75097]: WARNING nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:10 user nova-compute[75097]: WARNING nova.compute.manager [req-f226d36d-598f-45f4-b832-072c92324389 req-8c2cd4bd-6a5e-432e-b99c-b43fe4fb8359 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:12 user nova-compute[75097]: WARNING nova.compute.manager [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:12 user nova-compute[75097]: WARNING nova.compute.manager [req-f5812aa1-3715-4e29-8490-6b7924a12eee req-3e1c94b8-6ab8-4461-80df-8b9b0f7799bf service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state active and task_state rescuing.
Nov 14 16:11:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-bd195398-e9d4-4efc-838c-d26dd117fadc tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:11:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing instance network info cache due to event network-changed-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] Acquiring lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] Acquired lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.network.neutron [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Refreshing network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:16 user nova-compute[75097]: INFO nova.compute.manager [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Terminating instance
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.network.neutron [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updated VIF entry in instance network info cache for port dbabe2fe-db2b-40eb-96d5-1d064d9c48c5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.network.neutron [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [{"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c2333d9f-3219-4ca1-a2bc-a1fb361655f1 req-1fb77dac-8f51-4531-95f9-432be8b95167 service nova] Releasing lock "refresh_cache-17946bc0-ba29-42a0-8993-74699b98d836" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-d472ca25-9951-4847-85b7-8e5399fe2518 req-13086f2b-07d4-4732-a3ec-204f2465d33c service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-unplugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d472ca25-9951-4847-85b7-8e5399fe2518 req-13086f2b-07d4-4732-a3ec-204f2465d33c service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d472ca25-9951-4847-85b7-8e5399fe2518 req-13086f2b-07d4-4732-a3ec-204f2465d33c service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d472ca25-9951-4847-85b7-8e5399fe2518 req-13086f2b-07d4-4732-a3ec-204f2465d33c service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-d472ca25-9951-4847-85b7-8e5399fe2518 req-13086f2b-07d4-4732-a3ec-204f2465d33c service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-unplugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-d472ca25-9951-4847-85b7-8e5399fe2518 req-13086f2b-07d4-4732-a3ec-204f2465d33c service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-unplugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:11:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Instance destroyed successfully.
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.objects.instance [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lazy-loading 'resources' on Instance uuid 17946bc0-ba29-42a0-8993-74699b98d836 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-919452920',display_name='tempest-TestShelveInstance-server-919452920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-919452920',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiY2HrfDj1C2gaBtxDT6WTs6MBko57MU0MO1DoFNrMJWy9jcDKy1reHO2T4cqs0aCY1D81Sz3UfemSj0ny7Sa7kXg17a1ROT+RVHOcbF2FqDNXX6sMOfTf0sAaJ1io50Q==',key_name='tempest-TestShelveInstance-372931991',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:09:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d8fef64a574c1a8f84050f13037e65',ramdisk_id='',reservation_id='r-fb53j1rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2055532680',owner_user_name='tempest-TestShelveInstance-2055532680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:09:37Z,user_data=None,user_id='fb8d8995adaf45e985b4b89db7aa0f1d',uuid=17946bc0-ba29-42a0-8993-74699b98d836,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converting VIF {"id": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "address": "fa:16:3e:63:8c:2e", "network": {"id": "04f27dcd-a222-4737-817b-1ed7356638b8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1486712733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d8fef64a574c1a8f84050f13037e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbabe2fe-db", "ovs_interfaceid": "dbabe2fe-db2b-40eb-96d5-1d064d9c48c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_vif [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbabe2fe-db, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24494cb7-f80d-4a7b-96be-775f6351a221) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:11:17 user nova-compute[75097]: INFO os_vif [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8c:2e,bridge_name='br-int',has_traffic_filtering=True,id=dbabe2fe-db2b-40eb-96d5-1d064d9c48c5,network=Network(04f27dcd-a222-4737-817b-1ed7356638b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbabe2fe-db')
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PiJOcdDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:11:17 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c97e24-41ca-4d38-b772-909bd98d1322]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:11:17 user nova-compute[75097]: No targets found.
Nov 14 16:11:17 user nova-compute[75097]: iSNS:
Nov 14 16:11:17 user nova-compute[75097]: No targets found.
Nov 14 16:11:17 user nova-compute[75097]: STATIC:
Nov 14 16:11:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913
Nov 14 16:11:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:11:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:11:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:11:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:11:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:11:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70
Nov 14 16:11:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:11:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:11:17 user nova-compute[75097]: FIRMWARE:
Nov 14 16:11:17 user nova-compute[75097]: No targets found.
Nov 14 16:11:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:11:17 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:11:17 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[068bdf57-2e24-4bcb-83bf-237b0fabbc07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8983a8b-7b40-436f-b843-4a0205c0d479]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:11:17 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:11:17 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:11:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 (non-flash)
Nov 14 16:11:17 user nova-compute[75097]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:11:17 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:11:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981cb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a67f12-d757-4168-bc43-dd8b900745b4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c2e053-780e-4d16-8180-9e3f506c401a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f238cc45-b190-4362-9d54-e993f8d4b823]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16c7d86-2f4c-40b6-9f3d-37defea42238]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b9ca77-54ba-4424-a12b-89d0383bc4de]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d2b318-6e26-48c1-9975-1eb55f73854a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260]
Nov 14 16:11:17 user nova-compute[75097]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70, portal: 172.16.0.220,3260] successful.
Nov 14 16:11:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d47ead-46be-4262-a78a-e2ed8c151a70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c929355-c108-434c-8524-ef2fda80c9f1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] <== disconnect_volume: return (312ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:11:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Deleting instance files /opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836_del
Nov 14 16:11:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Deletion of /opt/stack/data/nova/instances/17946bc0-ba29-42a0-8993-74699b98d836_del complete
Nov 14 16:11:17 user nova-compute[75097]: INFO nova.compute.manager [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 16:11:17 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:11:17 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:11:18 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:11:18 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Took 0.47 seconds to deallocate network for instance.
Nov 14 16:11:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-24fbb4f4-665b-49af-9903-ad6e54f55a09 req-bd7b5d53-ed85-42ba-abef-bf3f84708df8 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-deleted-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-5ace4e1d-3c23-4672-b710-543d0ce64152 req-cdf1c5cd-10e1-4179-b92f-ddca68c24613 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ace4e1d-3c23-4672-b710-543d0ce64152 req-cdf1c5cd-10e1-4179-b92f-ddca68c24613 service nova] Acquiring lock "17946bc0-ba29-42a0-8993-74699b98d836-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ace4e1d-3c23-4672-b710-543d0ce64152 req-cdf1c5cd-10e1-4179-b92f-ddca68c24613 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ace4e1d-3c23-4672-b710-543d0ce64152 req-cdf1c5cd-10e1-4179-b92f-ddca68c24613 service nova] Lock "17946bc0-ba29-42a0-8993-74699b98d836-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-5ace4e1d-3c23-4672-b710-543d0ce64152 req-cdf1c5cd-10e1-4179-b92f-ddca68c24613 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] No waiting events found dispatching network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:11:18 user nova-compute[75097]: WARNING nova.compute.manager [req-5ace4e1d-3c23-4672-b710-543d0ce64152 req-cdf1c5cd-10e1-4179-b92f-ddca68c24613 service nova] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Received unexpected event network-vif-plugged-dbabe2fe-db2b-40eb-96d5-1d064d9c48c5 for instance with vm_state active and task_state deleting.
Nov 14 16:11:19 user nova-compute[75097]: INFO nova.compute.manager [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Took 1.05 seconds to detach 1 volumes for instance.
Nov 14 16:11:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] [instance: 17946bc0-ba29-42a0-8993-74699b98d836] Deleting volume: 72d47ead-46be-4262-a78a-e2ed8c151a70 {{(pid=75097) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 16:11:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:11:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:11:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:19 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Deleted allocations for instance 17946bc0-ba29-42a0-8993-74699b98d836
Nov 14 16:11:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-910cae8b-c725-4c36-9729-1bb60a21eaa1 tempest-TestShelveInstance-2055532680 tempest-TestShelveInstance-2055532680-project-member] Lock "17946bc0-ba29-42a0-8993-74699b98d836" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.287s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:11:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:11:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:11:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:39 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:11:42 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=25.277790069580078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 67309ef7-8e83-4074-9419-2b815f7319bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 44342db6-8756-46db-a279-0557c24e5d2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:11:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:11:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:11:57 user nova-compute[75097]: INFO nova.compute.claims [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Claim successful on node user
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:11:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:11:57 user nova-compute[75097]: DEBUG nova.policy [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac22930f0fb94bfbabe013f477e056ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73525a2ed1ed475994a7d12cf23aa81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:11:58 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Creating image(s)
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "/opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk 1073741824" returned: 0 in 0.048s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Successfully created port: 24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Cannot resize image /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Ensure instance console log exists: /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:11:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Successfully updated port: 24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquired lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-changed-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Refreshing instance network info cache due to event network-changed-24f5578a-980a-470f-8d04-c4fb56c4886f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] Acquiring lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:11:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updating instance_info_cache with network_info: [{"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Releasing lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Instance network_info: |[{"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] Acquired lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.neutron [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Refreshing network info cache for port 24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Start _get_guest_xml network_info=[{"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:12:00 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:12:00 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-749294707',display_name='tempest-AttachVolumeNegativeTest-server-749294707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-749294707',id=26,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnQCmCaHgJO7/OHPep3HCU8hnDIaRturR4oS6KBtSS10k8ytBp+lv6UiSnHiNK862QHJAvqsJCDaDJZDLnx3G/kmbwZ62PeEzr2leI+Fa50Qek/hhOBagKHCsEUe2pCYQ==',key_name='tempest-keypair-1669947199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-x6olm09n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=c86a1ac2-6b4a-4bc8-9334-814716a820aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.objects.instance [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'pci_devices' on Instance uuid c86a1ac2-6b4a-4bc8-9334-814716a820aa {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:12:00 user nova-compute[75097]:   <uuid>c86a1ac2-6b4a-4bc8-9334-814716a820aa</uuid>
Nov 14 16:12:00 user nova-compute[75097]:   <name>instance-0000001a</name>
Nov 14 16:12:00 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:12:00 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:12:00 user nova-compute[75097]:   <metadata>
Nov 14 16:12:00 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:12:00 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:12:00 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeNegativeTest-server-749294707</nova:name>
Nov 14 16:12:00 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:12:00</nova:creationTime>
Nov 14 16:12:00 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:12:00 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:12:00 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:12:00 user nova-compute[75097]:       <nova:owner>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:user uuid="ac22930f0fb94bfbabe013f477e056ca">tempest-AttachVolumeNegativeTest-907754384-project-member</nova:user>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:project uuid="73525a2ed1ed475994a7d12cf23aa81f">tempest-AttachVolumeNegativeTest-907754384</nova:project>
Nov 14 16:12:00 user nova-compute[75097]:       </nova:owner>
Nov 14 16:12:00 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:12:00 user nova-compute[75097]:       <nova:ports>
Nov 14 16:12:00 user nova-compute[75097]:         <nova:port uuid="24f5578a-980a-470f-8d04-c4fb56c4886f">
Nov 14 16:12:00 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:12:00 user nova-compute[75097]:         </nova:port>
Nov 14 16:12:00 user nova-compute[75097]:       </nova:ports>
Nov 14 16:12:00 user nova-compute[75097]:     </nova:instance>
Nov 14 16:12:00 user nova-compute[75097]:   </metadata>
Nov 14 16:12:00 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:12:00 user nova-compute[75097]:     <system>
Nov 14 16:12:00 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:12:00 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:12:00 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:12:00 user nova-compute[75097]:       <entry name="serial">c86a1ac2-6b4a-4bc8-9334-814716a820aa</entry>
Nov 14 16:12:00 user nova-compute[75097]:       <entry name="uuid">c86a1ac2-6b4a-4bc8-9334-814716a820aa</entry>
Nov 14 16:12:00 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:12:00 user nova-compute[75097]:     </system>
Nov 14 16:12:00 user nova-compute[75097]:   </sysinfo>
Nov 14 16:12:00 user nova-compute[75097]:   <os>
Nov 14 16:12:00 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:12:00 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:12:00 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:12:00 user nova-compute[75097]:   </os>
Nov 14 16:12:00 user nova-compute[75097]:   <features>
Nov 14 16:12:00 user nova-compute[75097]:     <acpi/>
Nov 14 16:12:00 user nova-compute[75097]:     <apic/>
Nov 14 16:12:00 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:12:00 user nova-compute[75097]:   </features>
Nov 14 16:12:00 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:12:00 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:12:00 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:12:00 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:12:00 user nova-compute[75097]:   </clock>
Nov 14 16:12:00 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:12:00 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:12:00 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:12:00 user nova-compute[75097]:   </cpu>
Nov 14 16:12:00 user nova-compute[75097]:   <devices>
Nov 14 16:12:00 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:12:00 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:12:00 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk"/>
Nov 14 16:12:00 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:12:00 user nova-compute[75097]:     </disk>
Nov 14 16:12:00 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:12:00 user nova-compute[75097]:       <mac address="fa:16:3e:4c:b5:6f"/>
Nov 14 16:12:00 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:12:00 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:12:00 user nova-compute[75097]:       <target dev="tap24f5578a-98"/>
Nov 14 16:12:00 user nova-compute[75097]:     </interface>
Nov 14 16:12:00 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:12:00 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/console.log" append="off"/>
Nov 14 16:12:00 user nova-compute[75097]:     </serial>
Nov 14 16:12:00 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:12:00 user nova-compute[75097]:     <video>
Nov 14 16:12:00 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:12:00 user nova-compute[75097]:     </video>
Nov 14 16:12:00 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:12:00 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:12:00 user nova-compute[75097]:     </rng>
Nov 14 16:12:00 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:12:00 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:12:00 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:12:00 user nova-compute[75097]:     </memballoon>
Nov 14 16:12:00 user nova-compute[75097]:   </devices>
Nov 14 16:12:00 user nova-compute[75097]: </domain>
Nov 14 16:12:00 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-749294707',display_name='tempest-AttachVolumeNegativeTest-server-749294707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-749294707',id=26,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnQCmCaHgJO7/OHPep3HCU8hnDIaRturR4oS6KBtSS10k8ytBp+lv6UiSnHiNK862QHJAvqsJCDaDJZDLnx3G/kmbwZ62PeEzr2leI+Fa50Qek/hhOBagKHCsEUe2pCYQ==',key_name='tempest-keypair-1669947199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-x6olm09n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=c86a1ac2-6b4a-4bc8-9334-814716a820aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG os_vif [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49e4cce2-a575-58b8-8c74-aa3cfd8f8b45', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24f5578a-98, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24f5578a-98, col_values=(('qos', UUID('fce9a818-838e-4c02-9ad5-40623d1ef125')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24f5578a-98, col_values=(('external_ids', {'iface-id': '24f5578a-980a-470f-8d04-c4fb56c4886f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:b5:6f', 'vm-uuid': 'c86a1ac2-6b4a-4bc8-9334-814716a820aa'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:00 user nova-compute[75097]: INFO os_vif [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98')
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:4c:b5:6f, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.neutron [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updated VIF entry in instance network info cache for port 24f5578a-980a-470f-8d04-c4fb56c4886f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG nova.network.neutron [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updating instance_info_cache with network_info: [{"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-78d021f2-589b-45bb-8a84-45fffe4833ff req-fd1cc96d-b1e5-4dd7-8022-629dcd47608e service nova] Releasing lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-079484b2-868b-43db-8e05-99f29e90bb93 req-c4948493-6729-45a8-acec-9b8c4813583e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-079484b2-868b-43db-8e05-99f29e90bb93 req-c4948493-6729-45a8-acec-9b8c4813583e service nova] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-079484b2-868b-43db-8e05-99f29e90bb93 req-c4948493-6729-45a8-acec-9b8c4813583e service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-079484b2-868b-43db-8e05-99f29e90bb93 req-c4948493-6729-45a8-acec-9b8c4813583e service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-079484b2-868b-43db-8e05-99f29e90bb93 req-c4948493-6729-45a8-acec-9b8c4813583e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] No waiting events found dispatching network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:12:01 user nova-compute[75097]: WARNING nova.compute.manager [req-079484b2-868b-43db-8e05-99f29e90bb93 req-c4948493-6729-45a8-acec-9b8c4813583e service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received unexpected event network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f for instance with vm_state building and task_state spawning.
Nov 14 16:12:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:12:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Instance spawned successfully.
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-152b4901-971c-4341-8cde-8179fe4be80c req-5650fcb3-696c-4a8c-9a54-cc9721b9cb40 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-152b4901-971c-4341-8cde-8179fe4be80c req-5650fcb3-696c-4a8c-9a54-cc9721b9cb40 service nova] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-152b4901-971c-4341-8cde-8179fe4be80c req-5650fcb3-696c-4a8c-9a54-cc9721b9cb40 service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-152b4901-971c-4341-8cde-8179fe4be80c req-5650fcb3-696c-4a8c-9a54-cc9721b9cb40 service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-152b4901-971c-4341-8cde-8179fe4be80c req-5650fcb3-696c-4a8c-9a54-cc9721b9cb40 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] No waiting events found dispatching network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:12:03 user nova-compute[75097]: WARNING nova.compute.manager [req-152b4901-971c-4341-8cde-8179fe4be80c req-5650fcb3-696c-4a8c-9a54-cc9721b9cb40 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received unexpected event network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f for instance with vm_state building and task_state spawning.
Nov 14 16:12:03 user nova-compute[75097]: INFO nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 14 16:12:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:12:03 user nova-compute[75097]: INFO nova.compute.manager [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Took 6.52 seconds to build instance.
Nov 14 16:12:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-08742544-46d1-46b7-a079-888ca73bb814 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.629s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing instance network info cache due to event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updated VIF entry in instance network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51cf3839-225f-446b-94ae-b557bb779c44 req-9124e5e6-c0fa-4d27-ad04-d94464c6ddc1 service nova] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:10 user nova-compute[75097]: INFO nova.compute.manager [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Detaching volume 7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:12:10 user nova-compute[75097]: INFO nova.virt.block_device [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Attempting to driver detach volume 7c40ee51-599e-4517-adf0-048f12057641 from mountpoint /dev/vdb
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Attempting to detach device vdb from instance 67309ef7-8e83-4074-9419-2b815f7319bc from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:12:10 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:12:10 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:12:10 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:12:10 user nova-compute[75097]:   <serial>7c40ee51-599e-4517-adf0-048f12057641</serial>
Nov 14 16:12:10 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:12:10 user nova-compute[75097]: </disk>
Nov 14 16:12:10 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:12:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully detached device vdb from instance 67309ef7-8e83-4074-9419-2b815f7319bc from the persistent domain config.
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67309ef7-8e83-4074-9419-2b815f7319bc from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:12:10 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:12:10 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:12:10 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:12:10 user nova-compute[75097]:   <serial>7c40ee51-599e-4517-adf0-048f12057641</serial>
Nov 14 16:12:10 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:12:10 user nova-compute[75097]: </disk>
Nov 14 16:12:10 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:12:10 user nova-compute[75097]: INFO nova.compute.claims [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Claim successful on node user
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing instance network info cache due to event network-changed-b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Refreshing network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:12:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:12:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.policy [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e4dbd7176043dc87e7a41a87e60098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144c5ef426074ddca799c0f312162932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:12:11 user nova-compute[75097]: INFO nova.virt.block_device [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Booting with volume 7c3f0015-d535-45a5-86e8-d69f3e6cbe78 at /dev/vda
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updated VIF entry in instance network info cache for port b73faa98-1a48-4897-ae43-4ef1725547b2. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-668347e0-c199-4a96-a777-23a91b876edd req-ed877e02-a375-4dbc-ba19-ca958cff33e9 service nova] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG os_brick.utils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afee7ba-5c65-4f22-b03e-de23e19a5412]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17efa36-2ee7-4e7c-9bbf-f854e857bedf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd163b4-9455-4bd7-85e3-e17eca5255fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d58d72-ce81-4119-80fe-05a7f58b59f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:12:11 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:12:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b819082-a7fb-4673-9aca-6f372cf2fedc]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG os_brick.utils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:12:11 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating existing volume attachment record: d3820f76-b4ed-42cf-90be-8f91becad142 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Successfully created port: e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Successfully updated port: e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquired lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-changed-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Refreshing instance network info cache due to event network-changed-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] Acquiring lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:12:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Releasing lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance network_info: |[{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] Acquired lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Refreshing network info cache for port e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updated VIF entry in instance network info cache for port e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e592c79d-2f20-488e-9ab8-6475f4b8c002 req-b7b8c827-d95d-4e8d-b5e1-7d10decacde9 service nova] Releasing lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:12:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Creating image(s)
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Ensure instance console log exists: /opt/stack/data/nova/instances/ec6aa836-f4e8-4001-8273-6782614acfb8/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Start _get_guest_xml network_info=[{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec6aa836-f4e8-4001-8273-6782614acfb8', 'attached_at': '', 'detached_at': '', 'volume_id': '7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'serial': '7c3f0015-d535-45a5-86e8-d69f3e6cbe78'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'd3820f76-b4ed-42cf-90be-8f91becad142', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:12:16 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:12:16 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:12:16 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:12:16 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:12:16 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c023a74f-95e8-4a5d-9f07-7687f7429522]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:12:16 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8280c3-8678-4b7e-9fb5-ca1fa18558ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78] added
Nov 14 16:12:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92cb78-c62f-4b59-9b0a-2b22ce2382f4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[120187a5-b0b4-4897-b0dc-b8a4078089ca]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJCDTZXE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJCDTZXE" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dded603b-f116-4077-94b7-06b9f6443ea7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJCDTZXE'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b2b8f1-8fe9-4de4-80ff-d63a1e3d2cf1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150f59d-2d93-498b-82ef-8d6dec015887]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:12:16 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:12:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:12:16 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:12:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d20a08-ae90-4f8b-a6e8-d39b3e28846c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]
Nov 14 16:12:16 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.
Nov 14 16:12:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a392cfc-17a2-48e0-b300-d6b86b5a8b0a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91e274-31f0-4d6a-9010-8ffaa38f83f6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:12:17 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:12:17 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:12:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:12:17 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:12:17 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:12:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c28a4e-6103-41be-86ee-8bef381821d9]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:12:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23765343931316439', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765343931316439', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398788755',display_name='tempest-ServerActionsTestOtherA-server-398788755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398788755',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-e06avr4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=ec6aa836-f4e8-4001-8273-6782614acfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'pci_devices' on Instance uuid ec6aa836-f4e8-4001-8273-6782614acfb8 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:12:18 user nova-compute[75097]:   <uuid>ec6aa836-f4e8-4001-8273-6782614acfb8</uuid>
Nov 14 16:12:18 user nova-compute[75097]:   <name>instance-0000001b</name>
Nov 14 16:12:18 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:12:18 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:12:18 user nova-compute[75097]:   <metadata>
Nov 14 16:12:18 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:12:18 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:12:18 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherA-server-398788755</nova:name>
Nov 14 16:12:18 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:12:16</nova:creationTime>
Nov 14 16:12:18 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:12:18 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:12:18 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:12:18 user nova-compute[75097]:       <nova:owner>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:user uuid="e8e4dbd7176043dc87e7a41a87e60098">tempest-ServerActionsTestOtherA-715795194-project-member</nova:user>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:project uuid="144c5ef426074ddca799c0f312162932">tempest-ServerActionsTestOtherA-715795194</nova:project>
Nov 14 16:12:18 user nova-compute[75097]:       </nova:owner>
Nov 14 16:12:18 user nova-compute[75097]:       <nova:ports>
Nov 14 16:12:18 user nova-compute[75097]:         <nova:port uuid="e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1">
Nov 14 16:12:18 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 16:12:18 user nova-compute[75097]:         </nova:port>
Nov 14 16:12:18 user nova-compute[75097]:       </nova:ports>
Nov 14 16:12:18 user nova-compute[75097]:     </nova:instance>
Nov 14 16:12:18 user nova-compute[75097]:   </metadata>
Nov 14 16:12:18 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:12:18 user nova-compute[75097]:     <system>
Nov 14 16:12:18 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:12:18 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:12:18 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:12:18 user nova-compute[75097]:       <entry name="serial">ec6aa836-f4e8-4001-8273-6782614acfb8</entry>
Nov 14 16:12:18 user nova-compute[75097]:       <entry name="uuid">ec6aa836-f4e8-4001-8273-6782614acfb8</entry>
Nov 14 16:12:18 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:12:18 user nova-compute[75097]:     </system>
Nov 14 16:12:18 user nova-compute[75097]:   </sysinfo>
Nov 14 16:12:18 user nova-compute[75097]:   <os>
Nov 14 16:12:18 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:12:18 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:12:18 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:12:18 user nova-compute[75097]:   </os>
Nov 14 16:12:18 user nova-compute[75097]:   <features>
Nov 14 16:12:18 user nova-compute[75097]:     <acpi/>
Nov 14 16:12:18 user nova-compute[75097]:     <apic/>
Nov 14 16:12:18 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:12:18 user nova-compute[75097]:   </features>
Nov 14 16:12:18 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:12:18 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:12:18 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:12:18 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:12:18 user nova-compute[75097]:   </clock>
Nov 14 16:12:18 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:12:18 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:12:18 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:12:18 user nova-compute[75097]:   </cpu>
Nov 14 16:12:18 user nova-compute[75097]:   <devices>
Nov 14 16:12:18 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:12:18 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:12:18 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:12:18 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:12:18 user nova-compute[75097]:       <serial>7c3f0015-d535-45a5-86e8-d69f3e6cbe78</serial>
Nov 14 16:12:18 user nova-compute[75097]:     </disk>
Nov 14 16:12:18 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:12:18 user nova-compute[75097]:       <mac address="fa:16:3e:22:17:30"/>
Nov 14 16:12:18 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:12:18 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:12:18 user nova-compute[75097]:       <target dev="tape88d4652-4c"/>
Nov 14 16:12:18 user nova-compute[75097]:     </interface>
Nov 14 16:12:18 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:12:18 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/ec6aa836-f4e8-4001-8273-6782614acfb8/console.log" append="off"/>
Nov 14 16:12:18 user nova-compute[75097]:     </serial>
Nov 14 16:12:18 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:12:18 user nova-compute[75097]:     <video>
Nov 14 16:12:18 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:12:18 user nova-compute[75097]:     </video>
Nov 14 16:12:18 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:12:18 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:12:18 user nova-compute[75097]:     </rng>
Nov 14 16:12:18 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:12:18 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:12:18 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:12:18 user nova-compute[75097]:     </memballoon>
Nov 14 16:12:18 user nova-compute[75097]:   </devices>
Nov 14 16:12:18 user nova-compute[75097]: </domain>
Nov 14 16:12:18 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398788755',display_name='tempest-ServerActionsTestOtherA-server-398788755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398788755',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-e06avr4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=ec6aa836-f4e8-4001-8273-6782614acfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG os_vif [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '931220bd-0cd8-5a0f-84ff-bba8ab779839', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape88d4652-4c, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape88d4652-4c, col_values=(('qos', UUID('7fdb91a4-0043-43ee-85f5-a6aad3e8fedf')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape88d4652-4c, col_values=(('external_ids', {'iface-id': 'e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:17:30', 'vm-uuid': 'ec6aa836-f4e8-4001-8273-6782614acfb8'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:18 user nova-compute[75097]: INFO os_vif [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c')
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:12:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No VIF found with MAC fa:16:3e:22:17:30, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-75315a18-e0bf-4fbc-840e-4860fa47c04a req-5f0b320e-1303-4aef-97c4-5050c9d33ae3 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-75315a18-e0bf-4fbc-840e-4860fa47c04a req-5f0b320e-1303-4aef-97c4-5050c9d33ae3 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-75315a18-e0bf-4fbc-840e-4860fa47c04a req-5f0b320e-1303-4aef-97c4-5050c9d33ae3 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-75315a18-e0bf-4fbc-840e-4860fa47c04a req-5f0b320e-1303-4aef-97c4-5050c9d33ae3 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-75315a18-e0bf-4fbc-840e-4860fa47c04a req-5f0b320e-1303-4aef-97c4-5050c9d33ae3 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:12:19 user nova-compute[75097]: WARNING nova.compute.manager [req-75315a18-e0bf-4fbc-840e-4860fa47c04a req-5f0b320e-1303-4aef-97c4-5050c9d33ae3 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state building and task_state spawning.
Nov 14 16:12:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:12:21 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance spawned successfully.
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-415e1cf8-d435-4dc5-b923-78a6d145b308 req-bace7a49-1835-4a73-9d15-144449c77eee service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-415e1cf8-d435-4dc5-b923-78a6d145b308 req-bace7a49-1835-4a73-9d15-144449c77eee service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-415e1cf8-d435-4dc5-b923-78a6d145b308 req-bace7a49-1835-4a73-9d15-144449c77eee service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-415e1cf8-d435-4dc5-b923-78a6d145b308 req-bace7a49-1835-4a73-9d15-144449c77eee service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-415e1cf8-d435-4dc5-b923-78a6d145b308 req-bace7a49-1835-4a73-9d15-144449c77eee service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:12:21 user nova-compute[75097]: WARNING nova.compute.manager [req-415e1cf8-d435-4dc5-b923-78a6d145b308 req-bace7a49-1835-4a73-9d15-144449c77eee service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state building and task_state spawning.
Nov 14 16:12:21 user nova-compute[75097]: INFO nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 14 16:12:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:12:21 user nova-compute[75097]: INFO nova.compute.manager [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Took 10.92 seconds to build instance.
Nov 14 16:12:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5558748b-d532-4ca1-ae4e-2104a1073785 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.011s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:12:22 user nova-compute[75097]: INFO nova.compute.manager [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] instance snapshotting
Nov 14 16:12:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Beginning live snapshot process
Nov 14 16:12:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json -f qcow2" returned: 0 in 0.249s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4wqk3tkb/e5b049181b40418d879d8338a252f631.delta 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4wqk3tkb/e5b049181b40418d879d8338a252f631.delta 1073741824" returned: 0 in 0.049s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:23 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 16:12:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:12:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:12:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 16:12:24 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:12:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4wqk3tkb/e5b049181b40418d879d8338a252f631.delta /opt/stack/data/nova/instances/snapshots/tmp4wqk3tkb/e5b049181b40418d879d8338a252f631 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4wqk3tkb/e5b049181b40418d879d8338a252f631.delta /opt/stack/data/nova/instances/snapshots/tmp4wqk3tkb/e5b049181b40418d879d8338a252f631" returned: 0 in 0.604s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Snapshot extracted, beginning image upload
Nov 14 16:12:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Snapshot image upload complete
Nov 14 16:12:28 user nova-compute[75097]: INFO nova.compute.manager [None req-23dffa4f-db58-4191-983d-1255aa06f22a tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Took 5.70 seconds to snapshot the instance on the hypervisor.
Nov 14 16:12:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67309ef7-8e83-4074-9419-2b815f7319bc is timed out.
Nov 14 16:12:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully detached device vdb from instance 67309ef7-8e83-4074-9419-2b815f7319bc from the live domain config.
Nov 14 16:12:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRbpuELJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:12:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[34979ea9-2174-485d-9a24-93ca7b0fb9fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:831a029b-30d9-4d26-b7f4-8dcc87847f54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:12:30 user nova-compute[75097]: No targets found.
Nov 14 16:12:30 user nova-compute[75097]: iSNS:
Nov 14 16:12:30 user nova-compute[75097]: No targets found.
Nov 14 16:12:30 user nova-compute[75097]: STATIC:
Nov 14 16:12:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913
Nov 14 16:12:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:12:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:12:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:831a029b-30d9-4d26-b7f4-8dcc87847f54
Nov 14 16:12:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:12:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:12:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641
Nov 14 16:12:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:12:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:12:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:12:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:12:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:12:30 user nova-compute[75097]: FIRMWARE:
Nov 14 16:12:30 user nova-compute[75097]: No targets found.
Nov 14 16:12:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:12:30 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:12:30 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a27ab2-e9db-49e0-9be5-90f939a870d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:831a029b-30d9-4d26-b7f4-8dcc87847f54\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4861816-e61a-416f-91f9-e62ae89c27f1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831a029b-30d9-4d26-b7f4-8dcc87847f54 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831a029b-30d9-4d26-b7f4-8dcc87847f54 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:831a029b-30d9-4d26-b7f4-8dcc87847f54 (non-flash)
Nov 14 16:12:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf7867e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3bf3d4-5b22-4fc3-9507-9ab1b63ca51b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ed24d-a31a-4924-8af6-e0028d47add9]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe9c6a-3c1d-470b-bc78-657304af0356]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2ee093-4fd8-4db1-9eeb-f925cc49613c]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b669d3-a426-4388-9c63-730c1add75d9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[25791ee2-b25e-4c78-8c30-3a9a7a48fc9f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260]
Nov 14 16:12:30 user nova-compute[75097]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641, portal: 172.16.0.220,3260] successful.
Nov 14 16:12:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40ee51-599e-4517-adf0-048f12057641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8534fb-5d45-4965-90ab-6b156f0c19d2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== disconnect_volume: return (290ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:12:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:12:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:31 user nova-compute[75097]: DEBUG nova.objects.instance [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'flavor' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:12:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4cf5e85d-efaa-4fb3-94aa-711353211846 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:12:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:12:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:12:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.187686920166016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 67309ef7-8e83-4074-9419-2b815f7319bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 44342db6-8756-46db-a279-0557c24e5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c86a1ac2-6b4a-4bc8-9334-814716a820aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:12:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:12:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [{"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-67309ef7-8e83-4074-9419-2b815f7319bc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:12:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:12:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:59 user nova-compute[75097]: INFO nova.compute.manager [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Unrescuing
Nov 14 16:12:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'flavor' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-0539a433-f9e2-4849-8a0b-81f3a837c1f2 req-c4bb8696-0f74-4703-915f-5a676608b1d5 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0539a433-f9e2-4849-8a0b-81f3a837c1f2 req-c4bb8696-0f74-4703-915f-5a676608b1d5 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0539a433-f9e2-4849-8a0b-81f3a837c1f2 req-c4bb8696-0f74-4703-915f-5a676608b1d5 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0539a433-f9e2-4849-8a0b-81f3a837c1f2 req-c4bb8696-0f74-4703-915f-5a676608b1d5 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:12:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-0539a433-f9e2-4849-8a0b-81f3a837c1f2 req-c4bb8696-0f74-4703-915f-5a676608b1d5 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:12:59 user nova-compute[75097]: WARNING nova.compute.manager [req-0539a433-f9e2-4849-8a0b-81f3a837c1f2 req-c4bb8696-0f74-4703-915f-5a676608b1d5 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:13:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance destroyed successfully.
Nov 14 16:13:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:02 user nova-compute[75097]: WARNING nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:02 user nova-compute[75097]: WARNING nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:02 user nova-compute[75097]: WARNING nova.compute.manager [req-d0ab12a0-e888-47e8-aec8-dd9bcedd2d2b req-912be763-5486-436f-b359-e606a54e1911 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:02 user nova-compute[75097]: INFO nova.compute.manager [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Terminating instance
Nov 14 16:13:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Instance destroyed successfully.
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'resources' on Instance uuid 67309ef7-8e83-4074-9419-2b815f7319bc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-120930556',display_name='tempest-TestMinimumBasicScenario-server-120930556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-120930556',id=22,image_ref='dde149ce-fcc4-486a-a992-59b050089b91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3jBDAiF8kCAndilZ58Fs99JIfkE42J6F++n1FO3/O0tM2uNbRObIwQ2qLh02WXryHSD7wRS/gAjcahH75rfTvw3c2OF97XJ9va+szbkvd8N1XUkCpCvjT9T0yz5BC7Q==',key_name='tempest-TestMinimumBasicScenario-1286213988',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-9000gmu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dde149ce-fcc4-486a-a992-59b050089b91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:10:25Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=67309ef7-8e83-4074-9419-2b815f7319bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "b73faa98-1a48-4897-ae43-4ef1725547b2", "address": "fa:16:3e:d1:b5:f0", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73faa98-1a", "ovs_interfaceid": "b73faa98-1a48-4897-ae43-4ef1725547b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG os_vif [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73faa98-1a, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59249605-ecb5-4429-9fcc-05a6a23bdedb) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: INFO os_vif [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b5:f0,bridge_name='br-int',has_traffic_filtering=True,id=b73faa98-1a48-4897-ae43-4ef1725547b2,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73faa98-1a')
Nov 14 16:13:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Deleting instance files /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc_del
Nov 14 16:13:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Deletion of /opt/stack/data/nova/instances/67309ef7-8e83-4074-9419-2b815f7319bc_del complete
Nov 14 16:13:03 user nova-compute[75097]: INFO nova.compute.manager [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 16:13:03 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d754fefa-501d-4895-b9b4-89ee5f197624 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-unplugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-unplugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-unplugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:04 user nova-compute[75097]: WARNING nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state deleting.
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:04 user nova-compute[75097]: WARNING nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state deleting.
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:04 user nova-compute[75097]: WARNING nova.compute.manager [req-362251bf-e2f1-411e-a8b1-94586833456c req-c15c6112-627e-42e4-97e7-4988bf7fc7f2 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state active and task_state deleting.
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:13:04 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Took 0.68 seconds to deallocate network for instance.
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:04 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Deleted allocations for instance 67309ef7-8e83-4074-9419-2b815f7319bc
Nov 14 16:13:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0bd4d0ff-750a-42b4-8656-9df7b67b59b5 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "67309ef7-8e83-4074-9419-2b815f7319bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.036s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] Acquiring lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] Lock "67309ef7-8e83-4074-9419-2b815f7319bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] No waiting events found dispatching network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:06 user nova-compute[75097]: WARNING nova.compute.manager [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received unexpected event network-vif-plugged-b73faa98-1a48-4897-ae43-4ef1725547b2 for instance with vm_state deleted and task_state None.
Nov 14 16:13:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-78aed423-4d0f-4e12-ae23-894dbc5af937 req-f278b863-52dc-435f-8003-24ec2b241756 service nova] [instance: 67309ef7-8e83-4074-9419-2b815f7319bc] Received event network-vif-deleted-b73faa98-1a48-4897-ae43-4ef1725547b2 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:13:30 user nova-compute[75097]: INFO nova.compute.claims [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Claim successful on node user
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:13:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:13:30 user nova-compute[75097]: DEBUG nova.policy [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bb999bbbcf4d4c9058ea6921655732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aefeb20cd07a41f09d0c4e19e99518f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:13:30 user nova-compute[75097]: INFO nova.virt.block_device [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Booting with blank volume at /dev/vda
Nov 14 16:13:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Successfully created port: 1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Successfully updated port: 1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-changed-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Refreshing instance network info cache due to event network-changed-1db5225e-74ac-45ff-af6a-74ba19fbcfe9. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance network_info: |[{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:13:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Refreshing network info cache for port 1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:13:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updated VIF entry in instance network info cache for port 1db5225e-74ac-45ff-af6a-74ba19fbcfe9. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:13:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:13:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c96d9977-d736-48e4-8e85-f2e165c621d9 req-f91dfa14-613f-47dd-9d34-07b57c144787 service nova] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:13:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG os_brick.utils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[866cc301-c875-4ddc-b485-0ff4192bae97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2b93c-2cbf-47e8-a0d8-4e6623ef2f5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a4148-e438-42d5-a77f-07a982e3d466]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3db9b3-6b9c-4865-a947-6008b12d61fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:13:36 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:13:36 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6bd2f-0f89-429d-bf1e-f620798220d5]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG os_brick.utils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:13:36 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating existing volume attachment record: fe0311ce-3b72-491f-820e-dd6385a634fa {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:13:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:13:41 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Creating image(s)
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Ensure instance console log exists: /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Start _get_guest_xml network_info=[{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8d51b37-5f88-45f1-876b-99e387812c3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffbabaed-6d22-46f9-9649-e87681a00f73', 'serial': 'ffbabaed-6d22-46f9-9649-e87681a00f73'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'fe0311ce-3b72-491f-820e-dd6385a634fa', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:13:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:13:41 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:13:41 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:13:41 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:13:41 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51449864-9549-4b48-a81b-c45112145568]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:13:41 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8b117b-f320-41ae-bc23-8d7de032d1a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73] added
Nov 14 16:13:41 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff90cf2-c004-4d84-8e53-f2955d456e55]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec04aa-7462-496e-bbb2-31a36d853fa3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJqzrPZX {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJqzrPZX" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3975c46c-d314-44a2-94fa-cd50369885a3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oJqzrPZX'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e862d7-1f76-4fb0-99d1-15eb3108a3e4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[35495244-7e2e-4294-bae2-0f87922f58ba]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ce992-c459-42d1-9130-fa7f778571ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260]
Nov 14 16:13:41 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260] successful.
Nov 14 16:13:41 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1cccd-a752-4962-a004-ae4a5190e473]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b25077-8a93-4bca-a9e4-96c3c9d83ada]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:13:41 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3c22b-00a9-492a-bc0a-22437279dbe7]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23234656338393362', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234656338393362', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1215259689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1215259689',id=28,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-bf08lva9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:13:31Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=f8d51b37-5f88-45f1-876b-99e387812c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'pci_devices' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:13:42 user nova-compute[75097]:   <uuid>f8d51b37-5f88-45f1-876b-99e387812c3c</uuid>
Nov 14 16:13:42 user nova-compute[75097]:   <name>instance-0000001c</name>
Nov 14 16:13:42 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:13:42 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:13:42 user nova-compute[75097]:   <metadata>
Nov 14 16:13:42 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:13:42 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:13:42 user nova-compute[75097]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1215259689</nova:name>
Nov 14 16:13:42 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:13:41</nova:creationTime>
Nov 14 16:13:42 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:13:42 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:13:42 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:13:42 user nova-compute[75097]:       <nova:owner>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:user uuid="b4bb999bbbcf4d4c9058ea6921655732">tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member</nova:user>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:project uuid="aefeb20cd07a41f09d0c4e19e99518f0">tempest-ServerBootFromVolumeStableRescueTest-1745607452</nova:project>
Nov 14 16:13:42 user nova-compute[75097]:       </nova:owner>
Nov 14 16:13:42 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:13:42 user nova-compute[75097]:       <nova:ports>
Nov 14 16:13:42 user nova-compute[75097]:         <nova:port uuid="1db5225e-74ac-45ff-af6a-74ba19fbcfe9">
Nov 14 16:13:42 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 16:13:42 user nova-compute[75097]:         </nova:port>
Nov 14 16:13:42 user nova-compute[75097]:       </nova:ports>
Nov 14 16:13:42 user nova-compute[75097]:     </nova:instance>
Nov 14 16:13:42 user nova-compute[75097]:   </metadata>
Nov 14 16:13:42 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:13:42 user nova-compute[75097]:     <system>
Nov 14 16:13:42 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:13:42 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:13:42 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:13:42 user nova-compute[75097]:       <entry name="serial">f8d51b37-5f88-45f1-876b-99e387812c3c</entry>
Nov 14 16:13:42 user nova-compute[75097]:       <entry name="uuid">f8d51b37-5f88-45f1-876b-99e387812c3c</entry>
Nov 14 16:13:42 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:13:42 user nova-compute[75097]:     </system>
Nov 14 16:13:42 user nova-compute[75097]:   </sysinfo>
Nov 14 16:13:42 user nova-compute[75097]:   <os>
Nov 14 16:13:42 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:13:42 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:13:42 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:13:42 user nova-compute[75097]:   </os>
Nov 14 16:13:42 user nova-compute[75097]:   <features>
Nov 14 16:13:42 user nova-compute[75097]:     <acpi/>
Nov 14 16:13:42 user nova-compute[75097]:     <apic/>
Nov 14 16:13:42 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:13:42 user nova-compute[75097]:   </features>
Nov 14 16:13:42 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:13:42 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:13:42 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:13:42 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:13:42 user nova-compute[75097]:   </clock>
Nov 14 16:13:42 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:13:42 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:13:42 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:13:42 user nova-compute[75097]:   </cpu>
Nov 14 16:13:42 user nova-compute[75097]:   <devices>
Nov 14 16:13:42 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:13:42 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:13:42 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:13:42 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:13:42 user nova-compute[75097]:       <serial>ffbabaed-6d22-46f9-9649-e87681a00f73</serial>
Nov 14 16:13:42 user nova-compute[75097]:     </disk>
Nov 14 16:13:42 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:13:42 user nova-compute[75097]:       <mac address="fa:16:3e:0f:90:a8"/>
Nov 14 16:13:42 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:13:42 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:13:42 user nova-compute[75097]:       <target dev="tap1db5225e-74"/>
Nov 14 16:13:42 user nova-compute[75097]:     </interface>
Nov 14 16:13:42 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:13:42 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/console.log" append="off"/>
Nov 14 16:13:42 user nova-compute[75097]:     </serial>
Nov 14 16:13:42 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:13:42 user nova-compute[75097]:     <video>
Nov 14 16:13:42 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:13:42 user nova-compute[75097]:     </video>
Nov 14 16:13:42 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:13:42 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:13:42 user nova-compute[75097]:     </rng>
Nov 14 16:13:42 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:13:42 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:13:42 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:13:42 user nova-compute[75097]:     </memballoon>
Nov 14 16:13:42 user nova-compute[75097]:   </devices>
Nov 14 16:13:42 user nova-compute[75097]: </domain>
Nov 14 16:13:42 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1215259689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1215259689',id=28,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-bf08lva9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:13:31Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=f8d51b37-5f88-45f1-876b-99e387812c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG os_vif [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a73af43-af2a-5ebb-afd9-0615352ccf50', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db5225e-74, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db5225e-74, col_values=(('qos', UUID('84346c36-580c-4ed0-9387-3154a023165b')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db5225e-74, col_values=(('external_ids', {'iface-id': '1db5225e-74ac-45ff-af6a-74ba19fbcfe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:90:a8', 'vm-uuid': 'f8d51b37-5f88-45f1-876b-99e387812c3c'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:42 user nova-compute[75097]: INFO os_vif [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74')
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No VIF found with MAC fa:16:3e:0f:90:a8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:13:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8163MB free_disk=25.213333129882812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 44342db6-8756-46db-a279-0557c24e5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c86a1ac2-6b4a-4bc8-9334-814716a820aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-50e77ec4-913c-422b-926b-f958d5ae0a42 req-8db7d563-63f2-45cc-973a-5e3a5919d7d2 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50e77ec4-913c-422b-926b-f958d5ae0a42 req-8db7d563-63f2-45cc-973a-5e3a5919d7d2 service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50e77ec4-913c-422b-926b-f958d5ae0a42 req-8db7d563-63f2-45cc-973a-5e3a5919d7d2 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-50e77ec4-913c-422b-926b-f958d5ae0a42 req-8db7d563-63f2-45cc-973a-5e3a5919d7d2 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-50e77ec4-913c-422b-926b-f958d5ae0a42 req-8db7d563-63f2-45cc-973a-5e3a5919d7d2 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:44 user nova-compute[75097]: WARNING nova.compute.manager [req-50e77ec4-913c-422b-926b-f958d5ae0a42 req-8db7d563-63f2-45cc-973a-5e3a5919d7d2 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state building and task_state spawning.
Nov 14 16:13:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:13:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance spawned successfully.
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:13:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:13:46 user nova-compute[75097]: INFO nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 14 16:13:46 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:13:46 user nova-compute[75097]: INFO nova.compute.manager [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Took 15.99 seconds to build instance.
Nov 14 16:13:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a883fb-ff38-43ed-b98c-6ebcd46ca615 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.077s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-85450af9-aeec-46cc-87f0-db711432d7b5 req-a34580a8-9241-4596-93c7-7bdcf42e251a service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85450af9-aeec-46cc-87f0-db711432d7b5 req-a34580a8-9241-4596-93c7-7bdcf42e251a service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85450af9-aeec-46cc-87f0-db711432d7b5 req-a34580a8-9241-4596-93c7-7bdcf42e251a service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85450af9-aeec-46cc-87f0-db711432d7b5 req-a34580a8-9241-4596-93c7-7bdcf42e251a service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-85450af9-aeec-46cc-87f0-db711432d7b5 req-a34580a8-9241-4596-93c7-7bdcf42e251a service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:13:46 user nova-compute[75097]: WARNING nova.compute.manager [req-85450af9-aeec-46cc-87f0-db711432d7b5 req-a34580a8-9241-4596-93c7-7bdcf42e251a service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state active and task_state None.
Nov 14 16:13:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-changed-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Refreshing instance network info cache due to event network-changed-24f5578a-980a-470f-8d04-c4fb56c4886f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] Acquiring lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] Acquired lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Refreshing network info cache for port 24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updated VIF entry in instance network info cache for port 24f5578a-980a-470f-8d04-c4fb56c4886f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updating instance_info_cache with network_info: [{"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:13:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0af263ff-b94e-4417-bfd7-85135d25dc6c req-09e18e44-d68c-49db-b151-3c982e4d4d39 service nova] Releasing lock "refresh_cache-c86a1ac2-6b4a-4bc8-9334-814716a820aa" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG nova.objects.instance [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid c86a1ac2-6b4a-4bc8-9334-814716a820aa {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:49 user nova-compute[75097]: INFO nova.compute.manager [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Attaching volume d4beffe8-414d-4b0a-b516-45c9f163c2e1 to /dev/vdb
Nov 14 16:13:49 user nova-compute[75097]: DEBUG os_brick.utils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ea3f10-0e47-4e5d-9bd9-faafee079927]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[db062bb6-32db-4cc2-af69-d25a3e734ad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f220e9-a153-4ca1-8c4e-ce57190e8217]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e64996-9066-4500-9a08-939ff37b3d09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:13:49 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:13:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bee995-3c09-4feb-ba60-d88202e579a6]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG os_brick.utils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:13:49 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updating existing volume attachment record: ab86a35c-7ab0-4c07-ac03-28b163c9be2a {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:13:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfoXakhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:13:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:13:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:13:54 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc86c636-9b98-4c5a-9188-8b50e329697d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:13:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed32b4-f74d-43c7-8b26-a8205be5173e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1] added
Nov 14 16:13:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2df1d-3de0-44bc-ae9a-900c22c9cc42]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a6ea5-0e90-49e4-bf5f-c1c5ce9eada4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfoXakhH {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfoXakhH" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[023238a0-2378-4772-8473-40f330b95938]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lfoXakhH'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701c96b-ec25-496b-b84b-2e690091ade8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fea1a6-a95e-4d82-b659-bb001bd89abf]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5804d3a-7047-4594-9087-23ba218cbbbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260]
Nov 14 16:13:54 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260] successful.
Nov 14 16:13:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf1ec79-0c60-4af2-93a0-7140ed3cf0bc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc3b2a-572c-4a31-9b64-7592b227ba9d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:13:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2521f49-988c-4a7d-80b0-a82d8fcf07b0]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:13:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfoXakhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23063383932636339', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063383932636339', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid c86a1ac2-6b4a-4bc8-9334-814716a820aa {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:13:55 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:13:55 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:13:55 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:13:55 user nova-compute[75097]:   <serial>d4beffe8-414d-4b0a-b516-45c9f163c2e1</serial>
Nov 14 16:13:55 user nova-compute[75097]: </disk>
Nov 14 16:13:55 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:13:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:4c:b5:6f, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5cdab78a-8035-4981-b46d-4b6d3c5deded tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.266s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:13:56 user nova-compute[75097]: INFO nova.compute.claims [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Claim successful on node user
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:56 user nova-compute[75097]: INFO nova.compute.manager [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Detaching volume d4beffe8-414d-4b0a-b516-45c9f163c2e1
Nov 14 16:13:56 user nova-compute[75097]: INFO nova.virt.block_device [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Attempting to driver detach volume d4beffe8-414d-4b0a-b516-45c9f163c2e1 from mountpoint /dev/vdb
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Attempting to detach device vdb from instance c86a1ac2-6b4a-4bc8-9334-814716a820aa from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:13:56 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:13:56 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:13:56 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:13:56 user nova-compute[75097]:   <serial>d4beffe8-414d-4b0a-b516-45c9f163c2e1</serial>
Nov 14 16:13:56 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:13:56 user nova-compute[75097]: </disk>
Nov 14 16:13:56 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:13:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully detached device vdb from instance c86a1ac2-6b4a-4bc8-9334-814716a820aa from the persistent domain config.
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c86a1ac2-6b4a-4bc8-9334-814716a820aa from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:13:56 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:13:56 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:13:56 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:13:56 user nova-compute[75097]:   <serial>d4beffe8-414d-4b0a-b516-45c9f163c2e1</serial>
Nov 14 16:13:56 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:13:56 user nova-compute[75097]: </disk>
Nov 14 16:13:56 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:13:56 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:13:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.policy [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '664b6227948844139c66874de91fab7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e9e2ab228546a3b3d0b34f27bb5677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c86a1ac2-6b4a-4bc8-9334-814716a820aa {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:13:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Creating image(s)
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "/opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "/opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "ed353afb77b70db9886d69ce4532a476e794030c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "ed353afb77b70db9886d69ce4532a476e794030c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Successfully created port: 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.virt.images [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] 5e16bc28-168a-4993-9406-4f9fc1222fe1 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.part /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.part /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.converted" returned: 0 in 0.684s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "ed353afb77b70db9886d69ce4532a476e794030c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.657s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Successfully updated port: 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing instance network info cache due to event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG nova.network.neutron [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:13:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c --force-share --output=json" returned: 0 in 0.204s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "ed353afb77b70db9886d69ce4532a476e794030c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "ed353afb77b70db9886d69ce4532a476e794030c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b398ebfe-4610-42be-9f72-610ce603ed8e req-bf00d418-fe98-4718-b053-4e0f50e42c62 service nova] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c,backing_fmt=raw /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c,backing_fmt=raw /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk 1073741824" returned: 0 in 0.045s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "ed353afb77b70db9886d69ce4532a476e794030c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance network_info: |[{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Cannot resize image /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Ensure instance console log exists: /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Start _get_guest_xml network_info=[{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T16:13:54Z,direct_url=<?>,disk_format='qcow2',id=5e16bc28-168a-4993-9406-4f9fc1222fe1,min_disk=0,min_ram=0,name='tempest-scenario-img--1826020249',owner='91e9e2ab228546a3b3d0b34f27bb5677',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T16:13:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '5e16bc28-168a-4993-9406-4f9fc1222fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:13:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:13:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T16:13:54Z,direct_url=<?>,disk_format='qcow2',id=5e16bc28-168a-4993-9406-4f9fc1222fe1,min_disk=0,min_ram=0,name='tempest-scenario-img--1826020249',owner='91e9e2ab228546a3b3d0b34f27bb5677',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T16:13:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980538968',display_name='tempest-TestMinimumBasicScenario-server-1980538968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980538968',id=29,image_ref='5e16bc28-168a-4993-9406-4f9fc1222fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyN1ijuNsWmrRCzYvBfPSAiCTTGxfl+g8iLl/LmhxAgBL9zeWR5hroZglVkdcQnNumaio3hpu7tIflOU207dQqwhbtjQyOSVi4TSVUVLC6lidZmgpKc3DYxUk4I/yI36A==',key_name='tempest-TestMinimumBasicScenario-1849422009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-1hy2mztn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e16bc28-168a-4993-9406-4f9fc1222fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:13:57Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=4fd98396-940a-4ee5-9ec8-4f64c8c73a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:13:59 user nova-compute[75097]:   <uuid>4fd98396-940a-4ee5-9ec8-4f64c8c73a53</uuid>
Nov 14 16:13:59 user nova-compute[75097]:   <name>instance-0000001d</name>
Nov 14 16:13:59 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:13:59 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:13:59 user nova-compute[75097]:   <metadata>
Nov 14 16:13:59 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:13:59 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:13:59 user nova-compute[75097]:       <nova:name>tempest-TestMinimumBasicScenario-server-1980538968</nova:name>
Nov 14 16:13:59 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:13:59</nova:creationTime>
Nov 14 16:13:59 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:13:59 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:13:59 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:13:59 user nova-compute[75097]:       <nova:owner>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:user uuid="664b6227948844139c66874de91fab7d">tempest-TestMinimumBasicScenario-359238341-project-member</nova:user>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:project uuid="91e9e2ab228546a3b3d0b34f27bb5677">tempest-TestMinimumBasicScenario-359238341</nova:project>
Nov 14 16:13:59 user nova-compute[75097]:       </nova:owner>
Nov 14 16:13:59 user nova-compute[75097]:       <nova:root type="image" uuid="5e16bc28-168a-4993-9406-4f9fc1222fe1"/>
Nov 14 16:13:59 user nova-compute[75097]:       <nova:ports>
Nov 14 16:13:59 user nova-compute[75097]:         <nova:port uuid="626a93f6-6527-40e1-9042-8dfb9d5dff92">
Nov 14 16:13:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:13:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:13:59 user nova-compute[75097]:       </nova:ports>
Nov 14 16:13:59 user nova-compute[75097]:     </nova:instance>
Nov 14 16:13:59 user nova-compute[75097]:   </metadata>
Nov 14 16:13:59 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:13:59 user nova-compute[75097]:     <system>
Nov 14 16:13:59 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:13:59 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:13:59 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:13:59 user nova-compute[75097]:       <entry name="serial">4fd98396-940a-4ee5-9ec8-4f64c8c73a53</entry>
Nov 14 16:13:59 user nova-compute[75097]:       <entry name="uuid">4fd98396-940a-4ee5-9ec8-4f64c8c73a53</entry>
Nov 14 16:13:59 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:13:59 user nova-compute[75097]:     </system>
Nov 14 16:13:59 user nova-compute[75097]:   </sysinfo>
Nov 14 16:13:59 user nova-compute[75097]:   <os>
Nov 14 16:13:59 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:13:59 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:13:59 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:13:59 user nova-compute[75097]:   </os>
Nov 14 16:13:59 user nova-compute[75097]:   <features>
Nov 14 16:13:59 user nova-compute[75097]:     <acpi/>
Nov 14 16:13:59 user nova-compute[75097]:     <apic/>
Nov 14 16:13:59 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:13:59 user nova-compute[75097]:   </features>
Nov 14 16:13:59 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:13:59 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:13:59 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:13:59 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:13:59 user nova-compute[75097]:   </clock>
Nov 14 16:13:59 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:13:59 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:13:59 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:13:59 user nova-compute[75097]:   </cpu>
Nov 14 16:13:59 user nova-compute[75097]:   <devices>
Nov 14 16:13:59 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:13:59 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:13:59 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk"/>
Nov 14 16:13:59 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:13:59 user nova-compute[75097]:     </disk>
Nov 14 16:13:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:13:59 user nova-compute[75097]:       <mac address="fa:16:3e:3d:62:22"/>
Nov 14 16:13:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:13:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:13:59 user nova-compute[75097]:       <target dev="tap626a93f6-65"/>
Nov 14 16:13:59 user nova-compute[75097]:     </interface>
Nov 14 16:13:59 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:13:59 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/console.log" append="off"/>
Nov 14 16:13:59 user nova-compute[75097]:     </serial>
Nov 14 16:13:59 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:13:59 user nova-compute[75097]:     <video>
Nov 14 16:13:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:13:59 user nova-compute[75097]:     </video>
Nov 14 16:13:59 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:13:59 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:13:59 user nova-compute[75097]:     </rng>
Nov 14 16:13:59 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:13:59 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:13:59 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:13:59 user nova-compute[75097]:     </memballoon>
Nov 14 16:13:59 user nova-compute[75097]:   </devices>
Nov 14 16:13:59 user nova-compute[75097]: </domain>
Nov 14 16:13:59 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980538968',display_name='tempest-TestMinimumBasicScenario-server-1980538968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980538968',id=29,image_ref='5e16bc28-168a-4993-9406-4f9fc1222fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyN1ijuNsWmrRCzYvBfPSAiCTTGxfl+g8iLl/LmhxAgBL9zeWR5hroZglVkdcQnNumaio3hpu7tIflOU207dQqwhbtjQyOSVi4TSVUVLC6lidZmgpKc3DYxUk4I/yI36A==',key_name='tempest-TestMinimumBasicScenario-1849422009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-1hy2mztn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e16bc28-168a-4993-9406-4f9fc1222fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:13:57Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=4fd98396-940a-4ee5-9ec8-4f64c8c73a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG os_vif [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e78c73a9-3300-5fd4-bed2-5f7d05674315', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap626a93f6-65, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap626a93f6-65, col_values=(('qos', UUID('83c2519d-4068-4c49-924c-ae108ec7a310')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap626a93f6-65, col_values=(('external_ids', {'iface-id': '626a93f6-6527-40e1-9042-8dfb9d5dff92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:62:22', 'vm-uuid': '4fd98396-940a-4ee5-9ec8-4f64c8c73a53'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:13:59 user nova-compute[75097]: INFO os_vif [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65')
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:13:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No VIF found with MAC fa:16:3e:3d:62:22, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc250395-a9c3-411e-8d04-583b8bf46f14 req-cd9968a1-3f56-45f8-9bfe-a53d18bd4d2d service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc250395-a9c3-411e-8d04-583b8bf46f14 req-cd9968a1-3f56-45f8-9bfe-a53d18bd4d2d service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc250395-a9c3-411e-8d04-583b8bf46f14 req-cd9968a1-3f56-45f8-9bfe-a53d18bd4d2d service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc250395-a9c3-411e-8d04-583b8bf46f14 req-cd9968a1-3f56-45f8-9bfe-a53d18bd4d2d service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc250395-a9c3-411e-8d04-583b8bf46f14 req-cd9968a1-3f56-45f8-9bfe-a53d18bd4d2d service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:01 user nova-compute[75097]: WARNING nova.compute.manager [req-bc250395-a9c3-411e-8d04-583b8bf46f14 req-cd9968a1-3f56-45f8-9bfe-a53d18bd4d2d service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state building and task_state spawning.
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:14:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance spawned successfully.
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:14:03 user nova-compute[75097]: INFO nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Stashing vm_state: active {{(pid=75097) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 16:14:03 user nova-compute[75097]: INFO nova.compute.manager [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Took 6.77 seconds to build instance.
Nov 14 16:14:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-01a5f9ce-603c-47a2-8181-eff2d2a7e57d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.867s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:14:03 user nova-compute[75097]: INFO nova.compute.claims [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Claim successful on node user
Nov 14 16:14:03 user nova-compute[75097]: INFO nova.compute.resource_tracker [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating resource usage from migration 99c7739e-8713-46b1-9093-d780c33002a7
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-changed-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Refreshing instance network info cache due to event network-changed-ea4601d8-356b-454b-945c-c469766efbab. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.network.neutron [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Refreshing network info cache for port ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:14:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.484s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:03 user nova-compute[75097]: INFO nova.compute.manager [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Migrating
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquired lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updated VIF entry in instance network info cache for port ea4601d8-356b-454b-945c-c469766efbab. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-changed-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Refreshing instance network info cache due to event network-changed-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Acquiring lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Releasing lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Acquired lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Refreshing network info cache for port e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Starting migrate_disk_and_power_off {{(pid=75097) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-73e874e2-ed25-4573-92c1-16d1f5c980ab req-f1244725-2876-453f-95d2-c64ae6c57640 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-unplugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-73e874e2-ed25-4573-92c1-16d1f5c980ab req-f1244725-2876-453f-95d2-c64ae6c57640 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-73e874e2-ed25-4573-92c1-16d1f5c980ab req-f1244725-2876-453f-95d2-c64ae6c57640 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-73e874e2-ed25-4573-92c1-16d1f5c980ab req-f1244725-2876-453f-95d2-c64ae6c57640 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-73e874e2-ed25-4573-92c1-16d1f5c980ab req-f1244725-2876-453f-95d2-c64ae6c57640 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-unplugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:04 user nova-compute[75097]: WARNING nova.compute.manager [req-73e874e2-ed25-4573-92c1-16d1f5c980ab req-f1244725-2876-453f-95d2-c64ae6c57640 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-unplugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state active and task_state resize_migrating.
Nov 14 16:14:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updated VIF entry in instance network info cache for port e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Releasing lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:05 user nova-compute[75097]: WARNING nova.compute.manager [req-e0bdd3c5-aab4-4823-9603-af661c460da9 req-cedd22a6-2593-4186-9610-fed49e0c43f8 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state active and task_state None.
Nov 14 16:14:05 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance destroyed successfully.
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398788755',display_name='tempest-ServerActionsTestOtherA-server-398788755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398788755',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-e06avr4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=ec6aa836-f4e8-4001-8273-6782614acfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape88d4652-4c, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fdb91a4-0043-43ee-85f5-a6aad3e8fedf) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:14:05 user nova-compute[75097]: INFO os_vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c')
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:14:05 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ac0ad-2bcb-4eb9-bca2-6de03da1baec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:14:05 user nova-compute[75097]: No targets found.
Nov 14 16:14:05 user nova-compute[75097]: iSNS:
Nov 14 16:14:05 user nova-compute[75097]: No targets found.
Nov 14 16:14:05 user nova-compute[75097]: STATIC:
Nov 14 16:14:05 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:14:05 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:05 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:05 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913
Nov 14 16:14:05 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:05 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:05 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1
Nov 14 16:14:05 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:05 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:05 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:14:05 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:05 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:05 user nova-compute[75097]: FIRMWARE:
Nov 14 16:14:05 user nova-compute[75097]: No targets found.
Nov 14 16:14:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:14:05 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:14:05 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe4547-38bf-4b1a-aaf5-c506d32975cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a50bf3-3866-4718-b343-d91000b6b03a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1a7191-5818-49fe-93f8-dd695efe84bd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d458a64b-6c6a-4700-8636-1724f7cffac0]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.040s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c509a3-afda-4012-bf51-4f8f16dbca04]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b9c9d-fd08-4802-80d9-fa3159b3013d]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2724967c-7e4911d95998558c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2724967c', '/dev/disk/by-id/scsi-23765343931316439') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ee648-cb69-4ef1-a851-2ea06cb9592f]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f494571-d722-466c-8665-92dc7adc791d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6571e149-7648-47fc-b588-66ed261d11a9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]
Nov 14 16:14:05 user nova-compute[75097]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.
Nov 14 16:14:05 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3fcbff-13c4-4b43-af28-bbdd6cfe3374]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== disconnect_volume: return (394ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:14:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG nova.network.neutron [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Port e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 binding to destination host user is already ACTIVE {{(pid=75097) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-9ab61bc7-65fb-4d83-8c42-e561ac0831a1 req-2f0aa715-9983-4a87-a52c-3b479af695b7 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9ab61bc7-65fb-4d83-8c42-e561ac0831a1 req-2f0aa715-9983-4a87-a52c-3b479af695b7 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9ab61bc7-65fb-4d83-8c42-e561ac0831a1 req-2f0aa715-9983-4a87-a52c-3b479af695b7 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9ab61bc7-65fb-4d83-8c42-e561ac0831a1 req-2f0aa715-9983-4a87-a52c-3b479af695b7 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-9ab61bc7-65fb-4d83-8c42-e561ac0831a1 req-2f0aa715-9983-4a87-a52c-3b479af695b7 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:06 user nova-compute[75097]: WARNING nova.compute.manager [req-9ab61bc7-65fb-4d83-8c42-e561ac0831a1 req-2f0aa715-9983-4a87-a52c-3b479af695b7 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state active and task_state resize_migrating.
Nov 14 16:14:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquired lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Releasing lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG os_brick.utils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2733f25-fc46-4553-8bb0-7fa73bb26173]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aa8af8-eef5-4156-bb73-e4862c5e28e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab401d4d-9091-4b49-81ae-fb63d6c77e52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef213a98-06f3-4650-9f75-0f8173559214]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:14:07 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:14:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c4fb5-83a9-4156-bccc-0cb2874f6fd0]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:14:07 user nova-compute[75097]: DEBUG os_brick.utils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:14:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Starting finish_migration {{(pid=75097) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:14:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Creating image(s)
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Ensure instance console log exists: /opt/stack/data/nova/instances/ec6aa836-f4e8-4001-8273-6782614acfb8/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Start _get_guest_xml network_info=[{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ec6aa836-f4e8-4001-8273-6782614acfb8', 'attached_at': '2023-11-14T16:14:12.000000', 'detached_at': '', 'volume_id': '7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'serial': '7c3f0015-d535-45a5-86e8-d69f3e6cbe78'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '2afaffc0-da8f-4118-bbea-622ffe6b1637', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:14:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:14:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:14:12 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:14:12 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:14:12 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe27d49-06bd-47a5-b962-fe8bf45f56d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:14:12 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e348f02-d812-48fe-956d-a724da825dce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78] added
Nov 14 16:14:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8577eb6b-e55a-4a02-aff8-892526cdc620]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca6495-972d-45d2-ba81-36060df8dabd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJCDTZXE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJCDTZXE" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c87f7-87ae-4f1c-82b5-0829cc93f6e1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJCDTZXE'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ec6a09-379a-47a2-98ec-a5a408d85f1c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58cdcca-3ebb-4c6e-9949-28c772e10f00]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3edcb6-4631-4237-90dc-3bda4cf8f593]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]
Nov 14 16:14:12 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.
Nov 14 16:14:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c22aed1-977e-446e-9e49-75beb2fa35f4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88f059c-b20c-4aff-90c1-de65b89beeec]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:14:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901a630-9971-4ce6-8821-f4fb4f852fed]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:14:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23765343931316439', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765343931316439', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398788755',display_name='tempest-ServerActionsTestOtherA-server-398788755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398788755',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-e06avr4s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=ec6aa836-f4e8-4001-8273-6782614acfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:14:13 user nova-compute[75097]:   <uuid>ec6aa836-f4e8-4001-8273-6782614acfb8</uuid>
Nov 14 16:14:13 user nova-compute[75097]:   <name>instance-0000001b</name>
Nov 14 16:14:13 user nova-compute[75097]:   <memory>2097152</memory>
Nov 14 16:14:13 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:14:13 user nova-compute[75097]:   <metadata>
Nov 14 16:14:13 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:14:13 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:14:13 user nova-compute[75097]:       <nova:name>tempest-ServerActionsTestOtherA-server-398788755</nova:name>
Nov 14 16:14:13 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:14:12</nova:creationTime>
Nov 14 16:14:13 user nova-compute[75097]:       <nova:flavor name="m1.small">
Nov 14 16:14:13 user nova-compute[75097]:         <nova:memory>2048</nova:memory>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:disk>20</nova:disk>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:14:13 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:14:13 user nova-compute[75097]:       <nova:owner>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:user uuid="e8e4dbd7176043dc87e7a41a87e60098">tempest-ServerActionsTestOtherA-715795194-project-member</nova:user>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:project uuid="144c5ef426074ddca799c0f312162932">tempest-ServerActionsTestOtherA-715795194</nova:project>
Nov 14 16:14:13 user nova-compute[75097]:       </nova:owner>
Nov 14 16:14:13 user nova-compute[75097]:       <nova:ports>
Nov 14 16:14:13 user nova-compute[75097]:         <nova:port uuid="e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1">
Nov 14 16:14:13 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 16:14:13 user nova-compute[75097]:         </nova:port>
Nov 14 16:14:13 user nova-compute[75097]:       </nova:ports>
Nov 14 16:14:13 user nova-compute[75097]:     </nova:instance>
Nov 14 16:14:13 user nova-compute[75097]:   </metadata>
Nov 14 16:14:13 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:14:13 user nova-compute[75097]:     <system>
Nov 14 16:14:13 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:14:13 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:14:13 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:14:13 user nova-compute[75097]:       <entry name="serial">ec6aa836-f4e8-4001-8273-6782614acfb8</entry>
Nov 14 16:14:13 user nova-compute[75097]:       <entry name="uuid">ec6aa836-f4e8-4001-8273-6782614acfb8</entry>
Nov 14 16:14:13 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:14:13 user nova-compute[75097]:     </system>
Nov 14 16:14:13 user nova-compute[75097]:   </sysinfo>
Nov 14 16:14:13 user nova-compute[75097]:   <os>
Nov 14 16:14:13 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:14:13 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:14:13 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:14:13 user nova-compute[75097]:   </os>
Nov 14 16:14:13 user nova-compute[75097]:   <features>
Nov 14 16:14:13 user nova-compute[75097]:     <acpi/>
Nov 14 16:14:13 user nova-compute[75097]:     <apic/>
Nov 14 16:14:13 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:14:13 user nova-compute[75097]:   </features>
Nov 14 16:14:13 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:14:13 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:14:13 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:14:13 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:14:13 user nova-compute[75097]:   </clock>
Nov 14 16:14:13 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:14:13 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:14:13 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:14:13 user nova-compute[75097]:   </cpu>
Nov 14 16:14:13 user nova-compute[75097]:   <devices>
Nov 14 16:14:13 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:14:13 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:14:13 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:14:13 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:14:13 user nova-compute[75097]:       <serial>7c3f0015-d535-45a5-86e8-d69f3e6cbe78</serial>
Nov 14 16:14:13 user nova-compute[75097]:     </disk>
Nov 14 16:14:13 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:14:13 user nova-compute[75097]:       <mac address="fa:16:3e:22:17:30"/>
Nov 14 16:14:13 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:14:13 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:14:13 user nova-compute[75097]:       <target dev="tape88d4652-4c"/>
Nov 14 16:14:13 user nova-compute[75097]:     </interface>
Nov 14 16:14:13 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:14:13 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/ec6aa836-f4e8-4001-8273-6782614acfb8/console.log" append="off"/>
Nov 14 16:14:13 user nova-compute[75097]:     </serial>
Nov 14 16:14:13 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:14:13 user nova-compute[75097]:     <video>
Nov 14 16:14:13 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:14:13 user nova-compute[75097]:     </video>
Nov 14 16:14:13 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:14:13 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:14:13 user nova-compute[75097]:     </rng>
Nov 14 16:14:13 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:14:13 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:14:13 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:14:13 user nova-compute[75097]:     </memballoon>
Nov 14 16:14:13 user nova-compute[75097]:   </devices>
Nov 14 16:14:13 user nova-compute[75097]: </domain>
Nov 14 16:14:13 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398788755',display_name='tempest-ServerActionsTestOtherA-server-398788755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398788755',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-e06avr4s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=ec6aa836-f4e8-4001-8273-6782614acfb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1185718809-network", "vif_mac": "fa:16:3e:22:17:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG os_vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '931220bd-0cd8-5a0f-84ff-bba8ab779839', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape88d4652-4c, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape88d4652-4c, col_values=(('qos', UUID('cb5075c8-edaf-4186-9504-992fdcc12a61')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape88d4652-4c, col_values=(('external_ids', {'iface-id': 'e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:17:30', 'vm-uuid': 'ec6aa836-f4e8-4001-8273-6782614acfb8'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:13 user nova-compute[75097]: INFO os_vif [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c')
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:14:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] No VIF found with MAC fa:16:3e:22:17:30, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:14:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-f210ae89-ce4d-456b-9f3b-5e866a15a425 req-c757190b-5646-4cfa-ba9a-6306b0e0c8a5 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f210ae89-ce4d-456b-9f3b-5e866a15a425 req-c757190b-5646-4cfa-ba9a-6306b0e0c8a5 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f210ae89-ce4d-456b-9f3b-5e866a15a425 req-c757190b-5646-4cfa-ba9a-6306b0e0c8a5 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f210ae89-ce4d-456b-9f3b-5e866a15a425 req-c757190b-5646-4cfa-ba9a-6306b0e0c8a5 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-f210ae89-ce4d-456b-9f3b-5e866a15a425 req-c757190b-5646-4cfa-ba9a-6306b0e0c8a5 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:15 user nova-compute[75097]: WARNING nova.compute.manager [req-f210ae89-ce4d-456b-9f3b-5e866a15a425 req-c757190b-5646-4cfa-ba9a-6306b0e0c8a5 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state active and task_state resize_finish.
Nov 14 16:14:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:14:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance running successfully.
Nov 14 16:14:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Failed to set time: agent not configured {{(pid=75097) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 16:14:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fb711231-a366-4c3a-a152-88acc54a9e0d tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] finish_migration finished successfully. {{(pid=75097) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-d8489cd2-ceeb-4526-bfd4-8050f774151b req-7721d1f1-6daa-4d39-bc53-e80590e97919 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8489cd2-ceeb-4526-bfd4-8050f774151b req-7721d1f1-6daa-4d39-bc53-e80590e97919 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8489cd2-ceeb-4526-bfd4-8050f774151b req-7721d1f1-6daa-4d39-bc53-e80590e97919 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8489cd2-ceeb-4526-bfd4-8050f774151b req-7721d1f1-6daa-4d39-bc53-e80590e97919 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-d8489cd2-ceeb-4526-bfd4-8050f774151b req-7721d1f1-6daa-4d39-bc53-e80590e97919 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:17 user nova-compute[75097]: WARNING nova.compute.manager [req-d8489cd2-ceeb-4526-bfd4-8050f774151b req-7721d1f1-6daa-4d39-bc53-e80590e97919 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state resized and task_state None.
Nov 14 16:14:17 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c86a1ac2-6b4a-4bc8-9334-814716a820aa is timed out.
Nov 14 16:14:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully detached device vdb from instance c86a1ac2-6b4a-4bc8-9334-814716a820aa from the live domain config.
Nov 14 16:14:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfoXakhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:14:17 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929716f-3182-4bb0-ab11-b7666dce6131]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:14:17 user nova-compute[75097]: No targets found.
Nov 14 16:14:17 user nova-compute[75097]: iSNS:
Nov 14 16:14:17 user nova-compute[75097]: No targets found.
Nov 14 16:14:17 user nova-compute[75097]: STATIC:
Nov 14 16:14:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:14:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913
Nov 14 16:14:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1
Nov 14 16:14:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:17 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:14:17 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:14:17 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:14:17 user nova-compute[75097]: FIRMWARE:
Nov 14 16:14:17 user nova-compute[75097]: No targets found.
Nov 14 16:14:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:14:17 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:14:17 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dddcfd-4f32-4833-8c2d-0241bcb02703]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0903794-62a5-49c3-9a5d-fc475ee24d21]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:14:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8bb50-dcdd-4d0d-9913-50f8167abc31]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9846d6a-41cd-4337-826d-2540cc722994]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa4dcc-8c7b-466e-a293-1bf7254ecd06]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b5ba06-4541-4844-b343-d1c1851852ea]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb410f6-3e09-4b77-bf25-577fd1bd47df]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a4cc6e-fabd-4024-a696-cfd82781dc3c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260]
Nov 14 16:14:17 user nova-compute[75097]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1, portal: 172.16.0.220,3260] successful.
Nov 14 16:14:17 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4beffe8-414d-4b0a-b516-45c9f163c2e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0316a279-f417-4b6f-9c41-61239183e46e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== disconnect_volume: return (287ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:14:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:14:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid c86a1ac2-6b4a-4bc8-9334-814716a820aa {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:14:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c4cb822d-a6be-42e9-9819-4c47cc249096 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:14:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:14:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:14:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.152748107910156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Applying migration context for instance ec6aa836-f4e8-4001-8273-6782614acfb8 as it has an incoming, in-progress migration 99c7739e-8713-46b1-9093-d780c33002a7. Migration status is finished {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 16:14:44 user nova-compute[75097]: INFO nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating resource usage from migration 99c7739e-8713-46b1-9093-d780c33002a7
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 44342db6-8756-46db-a279-0557c24e5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c86a1ac2-6b4a-4bc8-9334-814716a820aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Migration 99c7739e-8713-46b1-9093-d780c33002a7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:14:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:14:45 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:14:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:14:45 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:14:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:47 user nova-compute[75097]: INFO nova.compute.manager [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Terminating instance
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc50c512-0780-477a-9c7a-fc97449df626 req-9661c618-b1b6-4377-a795-856146300953 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-vif-unplugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc50c512-0780-477a-9c7a-fc97449df626 req-9661c618-b1b6-4377-a795-856146300953 service nova] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc50c512-0780-477a-9c7a-fc97449df626 req-9661c618-b1b6-4377-a795-856146300953 service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc50c512-0780-477a-9c7a-fc97449df626 req-9661c618-b1b6-4377-a795-856146300953 service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc50c512-0780-477a-9c7a-fc97449df626 req-9661c618-b1b6-4377-a795-856146300953 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] No waiting events found dispatching network-vif-unplugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc50c512-0780-477a-9c7a-fc97449df626 req-9661c618-b1b6-4377-a795-856146300953 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-vif-unplugged-24f5578a-980a-470f-8d04-c4fb56c4886f for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Instance destroyed successfully.
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.objects.instance [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'resources' on Instance uuid c86a1ac2-6b4a-4bc8-9334-814716a820aa {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-749294707',display_name='tempest-AttachVolumeNegativeTest-server-749294707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-749294707',id=26,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnQCmCaHgJO7/OHPep3HCU8hnDIaRturR4oS6KBtSS10k8ytBp+lv6UiSnHiNK862QHJAvqsJCDaDJZDLnx3G/kmbwZ62PeEzr2leI+Fa50Qek/hhOBagKHCsEUe2pCYQ==',key_name='tempest-keypair-1669947199',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-x6olm09n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=c86a1ac2-6b4a-4bc8-9334-814716a820aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "24f5578a-980a-470f-8d04-c4fb56c4886f", "address": "fa:16:3e:4c:b5:6f", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f5578a-98", "ovs_interfaceid": "24f5578a-980a-470f-8d04-c4fb56c4886f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG os_vif [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24f5578a-98, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fce9a818-838e-4c02-9ad5-40623d1ef125) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:14:47 user nova-compute[75097]: INFO os_vif [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:b5:6f,bridge_name='br-int',has_traffic_filtering=True,id=24f5578a-980a-470f-8d04-c4fb56c4886f,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f5578a-98')
Nov 14 16:14:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Deleting instance files /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa_del
Nov 14 16:14:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Deletion of /opt/stack/data/nova/instances/c86a1ac2-6b4a-4bc8-9334-814716a820aa_del complete
Nov 14 16:14:47 user nova-compute[75097]: INFO nova.compute.manager [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 16:14:47 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:14:47 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:14:48 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:48 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Took 0.81 seconds to deallocate network for instance.
Nov 14 16:14:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-4cd60870-e297-461c-82db-8cd79ca85b19 req-2a62480c-8e76-49ed-9fae-cd0bdf1eed38 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-vif-deleted-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:49 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Deleted allocations for instance c86a1ac2-6b4a-4bc8-9334-814716a820aa
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-e7520677-d00b-4c78-9f4e-c220b4810778 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-1d824969-f285-4b91-bbbf-41473d746be4 req-7345acd0-78d1-4e9e-a5fc-fe5c3045de54 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received event network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1d824969-f285-4b91-bbbf-41473d746be4 req-7345acd0-78d1-4e9e-a5fc-fe5c3045de54 service nova] Acquiring lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1d824969-f285-4b91-bbbf-41473d746be4 req-7345acd0-78d1-4e9e-a5fc-fe5c3045de54 service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1d824969-f285-4b91-bbbf-41473d746be4 req-7345acd0-78d1-4e9e-a5fc-fe5c3045de54 service nova] Lock "c86a1ac2-6b4a-4bc8-9334-814716a820aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-1d824969-f285-4b91-bbbf-41473d746be4 req-7345acd0-78d1-4e9e-a5fc-fe5c3045de54 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] No waiting events found dispatching network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:14:49 user nova-compute[75097]: WARNING nova.compute.manager [req-1d824969-f285-4b91-bbbf-41473d746be4 req-7345acd0-78d1-4e9e-a5fc-fe5c3045de54 service nova] [instance: c86a1ac2-6b4a-4bc8-9334-814716a820aa] Received unexpected event network-vif-plugged-24f5578a-980a-470f-8d04-c4fb56c4886f for instance with vm_state deleted and task_state None.
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [{"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-b524df86-e1ec-4255-ba03-e8a314560af9" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing instance network info cache due to event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updated VIF entry in instance network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:51 user nova-compute[75097]: INFO nova.compute.manager [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Detaching volume 1ea81709-5009-4081-be2d-0bdd7deff913
Nov 14 16:14:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1a7948b-e514-4e83-acba-73cd783fb51f req-61f1aca8-2e93-41f2-8efb-ff80c53abeb4 service nova] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:51 user nova-compute[75097]: INFO nova.virt.block_device [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Attempting to driver detach volume 1ea81709-5009-4081-be2d-0bdd7deff913 from mountpoint /dev/vdb
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Attempting to detach device vdb from instance 44342db6-8756-46db-a279-0557c24e5d2d from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:14:51 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:14:51 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:14:51 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:14:51 user nova-compute[75097]:   <serial>1ea81709-5009-4081-be2d-0bdd7deff913</serial>
Nov 14 16:14:51 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:14:51 user nova-compute[75097]: </disk>
Nov 14 16:14:51 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:14:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully detached device vdb from instance 44342db6-8756-46db-a279-0557c24e5d2d from the persistent domain config.
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44342db6-8756-46db-a279-0557c24e5d2d from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:14:51 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:14:51 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:14:51 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:14:51 user nova-compute[75097]:   <serial>1ea81709-5009-4081-be2d-0bdd7deff913</serial>
Nov 14 16:14:51 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:14:51 user nova-compute[75097]: </disk>
Nov 14 16:14:51 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:14:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:14:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing instance network info cache due to event network-changed-dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:14:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] Acquiring lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:14:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] Acquired lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:14:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Refreshing network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:14:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updated VIF entry in instance network info cache for port dbed1766-e24b-471a-9559-c738f87ed9cb. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:14:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [{"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:14:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a31ed532-4b5f-49d3-94da-cf457954ec63 req-2b9e0301-d2de-4304-8b7f-87d023e6a994 service nova] Releasing lock "refresh_cache-44342db6-8756-46db-a279-0557c24e5d2d" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:14:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:14:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:14:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:14:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:14:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:14:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:11 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44342db6-8756-46db-a279-0557c24e5d2d is timed out.
Nov 14 16:15:11 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully detached device vdb from instance 44342db6-8756-46db-a279-0557c24e5d2d from the live domain config.
Nov 14 16:15:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BWSXNlGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:15:11 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d090663-c717-40b9-b53e-626149c7e85e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:15:11 user nova-compute[75097]: No targets found.
Nov 14 16:15:11 user nova-compute[75097]: iSNS:
Nov 14 16:15:11 user nova-compute[75097]: No targets found.
Nov 14 16:15:11 user nova-compute[75097]: STATIC:
Nov 14 16:15:11 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:15:11 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:15:11 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:15:11 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913
Nov 14 16:15:11 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:15:11 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:15:11 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:15:11 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:15:11 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:15:11 user nova-compute[75097]: FIRMWARE:
Nov 14 16:15:11 user nova-compute[75097]: No targets found.
Nov 14 16:15:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:15:11 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:15:11 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23f4c6-b24b-48f7-acd6-27061b4a1817]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef87dfb-4f4a-4203-8efc-1a8e0e344b1a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:15:11 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:11 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 (non-flash)
Nov 14 16:15:11 user nova-compute[75097]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:11 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98763880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b4ac3-3256-41c9-812e-679926abe90b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0134a2-c6b3-42f0-b4d6-e87602f82edc]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95c31d-4fb5-4b64-b80a-9da31c3c0f97]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea3ee52-917a-49f5-82b6-d2b5349d651b]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2868708-9bc4-4b2d-a450-95db45187a81]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f4466-20dd-4b82-a587-64bfa7f84ba4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260]
Nov 14 16:15:12 user nova-compute[75097]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913, portal: 172.16.0.220,3260] successful.
Nov 14 16:15:12 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea81709-5009-4081-be2d-0bdd7deff913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc7ce2e-d0e4-47a6-8119-e11db5d8b59a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] <== disconnect_volume: return (304ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'flavor' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a3f0392-c6cb-45a1-9bbc-ff75d2cfae90 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:20 user nova-compute[75097]: INFO nova.compute.manager [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Rescuing
Nov 14 16:15:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:15:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:15:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG nova.network.neutron [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-abc8678d-a212-4059-82bc-6f24c3ebbff9 req-2a2faf40-4be7-4572-a6a1-200b840de5ef service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-abc8678d-a212-4059-82bc-6f24c3ebbff9 req-2a2faf40-4be7-4572-a6a1-200b840de5ef service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-abc8678d-a212-4059-82bc-6f24c3ebbff9 req-2a2faf40-4be7-4572-a6a1-200b840de5ef service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-abc8678d-a212-4059-82bc-6f24c3ebbff9 req-2a2faf40-4be7-4572-a6a1-200b840de5ef service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-abc8678d-a212-4059-82bc-6f24c3ebbff9 req-2a2faf40-4be7-4572-a6a1-200b840de5ef service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:21 user nova-compute[75097]: WARNING nova.compute.manager [req-abc8678d-a212-4059-82bc-6f24c3ebbff9 req-2a2faf40-4be7-4572-a6a1-200b840de5ef service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state active and task_state rescuing.
Nov 14 16:15:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance destroyed successfully.
Nov 14 16:15:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Attempting a stable device rescue
Nov 14 16:15:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75097) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 16:15:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:15:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Creating image(s)
Nov 14 16:15:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "053f11bb6eff8e38198b1f6521f2bb00b3e0c80d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "053f11bb6eff8e38198b1f6521f2bb00b3e0c80d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG nova.virt.images [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] 9df1e583-7bca-4ece-a6cc-0fd1c10206f5 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.part /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.part /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.converted" returned: 0 in 0.264s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5d67ed1-5d6b-4b2d-8019-f0cf714fea5c req-5d5019db-b694-40b0-abfa-3a3d598b86d0 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5d67ed1-5d6b-4b2d-8019-f0cf714fea5c req-5d5019db-b694-40b0-abfa-3a3d598b86d0 service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5d67ed1-5d6b-4b2d-8019-f0cf714fea5c req-5d5019db-b694-40b0-abfa-3a3d598b86d0 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e5d67ed1-5d6b-4b2d-8019-f0cf714fea5c req-5d5019db-b694-40b0-abfa-3a3d598b86d0 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-e5d67ed1-5d6b-4b2d-8019-f0cf714fea5c req-5d5019db-b694-40b0-abfa-3a3d598b86d0 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:23 user nova-compute[75097]: WARNING nova.compute.manager [req-e5d67ed1-5d6b-4b2d-8019-f0cf714fea5c req-5d5019db-b694-40b0-abfa-3a3d598b86d0 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state active and task_state rescuing.
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "053f11bb6eff8e38198b1f6521f2bb00b3e0c80d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.711s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "053f11bb6eff8e38198b1f6521f2bb00b3e0c80d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "053f11bb6eff8e38198b1f6521f2bb00b3e0c80d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d,backing_fmt=raw /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d,backing_fmt=raw /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue" returned: 0 in 0.058s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "053f11bb6eff8e38198b1f6521f2bb00b3e0c80d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'migration_context' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<f8d51b37-5f88-45f1-876b-99e387812c3c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Start _get_guest_xml network_info=[{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "vif_mac": "fa:16:3e:0f:90:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9df1e583-7bca-4ece-a6cc-0fd1c10206f5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f8d51b37-5f88-45f1-876b-99e387812c3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffbabaed-6d22-46f9-9649-e87681a00f73', 'serial': 'ffbabaed-6d22-46f9-9649-e87681a00f73'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'fe0311ce-3b72-491f-820e-dd6385a634fa', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'resources' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<f8d51b37-5f88-45f1-876b-99e387812c3c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'numa_topology' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<f8d51b37-5f88-45f1-876b-99e387812c3c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:15:24 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:15:24 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<f8d51b37-5f88-45f1-876b-99e387812c3c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:15:24 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:15:24 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:15:24 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1662b03-a9e8-44b2-8df3-f02c7556d40c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oJqzrPZX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 16:15:24 user nova-compute[75097]: node.name = iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:15:24 user nova-compute[75097]: node.tpgt = -1
Nov 14 16:15:24 user nova-compute[75097]: node.startup = automatic
Nov 14 16:15:24 user nova-compute[75097]: node.leading_login = No
Nov 14 16:15:24 user nova-compute[75097]: iface.iscsi_ifacename = default
Nov 14 16:15:24 user nova-compute[75097]: iface.net_ifacename = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.ipaddress = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.prefix_len = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.hwaddress = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.transport_name = tcp
Nov 14 16:15:24 user nova-compute[75097]: iface.initiatorname = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.vlan_id = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.vlan_priority = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.vlan_state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.iface_num = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.mtu = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.port = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.bootproto = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.subnet_mask = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.gateway = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_alt_client_id = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_dns = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_learn_iqn = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_vendor_id_state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_vendor_id = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.dhcp_slp_da = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.fragmentation = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.gratuitous_arp = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.incoming_forwarding = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.tos_state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.tos = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.ttl = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.delayed_ack = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.tcp_nagle = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.tcp_wsf_state = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.tcp_wsf = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.tcp_timer_scale = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.tcp_timestamp = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.redirect = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.def_task_mgmt_timeout = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.header_digest = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.data_digest = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.immediate_data = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.initial_r2t = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.data_seq_inorder = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.data_pdu_inorder = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.erl = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.max_receive_data_len = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.first_burst_len = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.max_outstanding_r2t = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.max_burst_len = 0
Nov 14 16:15:24 user nova-compute[75097]: iface.chap_auth = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.bidi_chap = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.strict_login_compliance = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.discovery_auth = <empty>
Nov 14 16:15:24 user nova-compute[75097]: iface.discovery_logout = <empty>
Nov 14 16:15:24 user nova-compute[75097]: node.discovery_address = <empty>
Nov 14 16:15:24 user nova-compute[75097]: node.discovery_port = 0
Nov 14 16:15:24 user nova-compute[75097]: node.discovery_type = static
Nov 14 16:15:24 user nova-compute[75097]: node.session.initial_cmdsn = 0
Nov 14 16:15:24 user nova-compute[75097]: node.session.initial_login_retry_max = 8
Nov 14 16:15:24 user nova-compute[75097]: node.session.xmit_thread_priority = -20
Nov 14 16:15:24 user nova-compute[75097]: node.session.cmds_max = 128
Nov 14 16:15:24 user nova-compute[75097]: node.session.queue_depth = 32
Nov 14 16:15:24 user nova-compute[75097]: node.session.nr_sessions = 1
Nov 14 16:15:24 user nova-compute[75097]: node.session.auth.authmethod = CHAP
Nov 14 16:15:24 user nova-compute[75097]: node.session.auth.username = oJqzrPZX
Nov 14 16:15:24 user nova-compute[75097]: node.session.auth.password = ***
Nov 14 16:15:24 user nova-compute[75097]: node.session.auth.username_in = <empty>
Nov 14 16:15:24 user nova-compute[75097]: node.session.auth.password_in = <empty>
Nov 14 16:15:24 user nova-compute[75097]: node.session.auth.chap_algs = MD5
Nov 14 16:15:24 user nova-compute[75097]: node.session.timeo.replacement_timeout = 120
Nov 14 16:15:24 user nova-compute[75097]: node.session.err_timeo.abort_timeout = 15
Nov 14 16:15:24 user nova-compute[75097]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 16:15:24 user nova-compute[75097]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 16:15:24 user nova-compute[75097]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.FastAbort = Yes
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.InitialR2T = No
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.ImmediateData = Yes
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.MaxConnections = 1
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 16:15:24 user nova-compute[75097]: node.session.iscsi.ERL = 0
Nov 14 16:15:24 user nova-compute[75097]: node.session.scan = manual
Nov 14 16:15:24 user nova-compute[75097]: node.session.reopen_max = 0
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].address = 172.16.0.220
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].port = 3260
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].startup = manual
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].tcp.window_size = 524288
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].tcp.type_of_service = 0
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].timeo.logout_timeout = 15
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].timeo.login_timeout = 15
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].timeo.auth_timeout = 45
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].iscsi.DataDigest = None
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].iscsi.IFMarker = No
Nov 14 16:15:24 user nova-compute[75097]: node.conn[0].iscsi.OFMarker = No
Nov 14 16:15:24 user nova-compute[75097]: # END RECORD
Nov 14 16:15:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcdaa13-062e-45c7-b25a-f82d0899577b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8fcdb-d62a-44db-8c62-f2d0216b5d6a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJqzrPZX {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oJqzrPZX" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a9cfd-14ef-4556-94f2-2e3edad8ace3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oJqzrPZX'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f36c9d-b4f8-4f91-b555-fbd2be6df090]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e28754c-1789-4dfa-8c61-2e6e8e6385ce]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:24 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:24 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:24 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] HCTL ('33', '0', '0', 0) found on session 34 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68ad00-f7be-42d4-b9ef-545b1d9c812f]: (4, ('0 0 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching for a device in session 34 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23234656338393362', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234656338393362', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1215259689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1215259689',id=28,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-bf08lva9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:13:46Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=f8d51b37-5f88-45f1-876b-99e387812c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "vif_mac": "fa:16:3e:0f:90:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "vif_mac": "fa:16:3e:0f:90:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'pci_devices' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.objects.base [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<f8d51b37-5f88-45f1-876b-99e387812c3c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:15:24 user nova-compute[75097]:   <uuid>f8d51b37-5f88-45f1-876b-99e387812c3c</uuid>
Nov 14 16:15:24 user nova-compute[75097]:   <name>instance-0000001c</name>
Nov 14 16:15:24 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:15:24 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:15:24 user nova-compute[75097]:   <metadata>
Nov 14 16:15:24 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:15:24 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:15:24 user nova-compute[75097]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1215259689</nova:name>
Nov 14 16:15:24 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:15:24</nova:creationTime>
Nov 14 16:15:24 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:15:24 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:15:24 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:15:24 user nova-compute[75097]:       <nova:owner>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:user uuid="b4bb999bbbcf4d4c9058ea6921655732">tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member</nova:user>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:project uuid="aefeb20cd07a41f09d0c4e19e99518f0">tempest-ServerBootFromVolumeStableRescueTest-1745607452</nova:project>
Nov 14 16:15:24 user nova-compute[75097]:       </nova:owner>
Nov 14 16:15:24 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:15:24 user nova-compute[75097]:       <nova:ports>
Nov 14 16:15:24 user nova-compute[75097]:         <nova:port uuid="1db5225e-74ac-45ff-af6a-74ba19fbcfe9">
Nov 14 16:15:24 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 16:15:24 user nova-compute[75097]:         </nova:port>
Nov 14 16:15:24 user nova-compute[75097]:       </nova:ports>
Nov 14 16:15:24 user nova-compute[75097]:     </nova:instance>
Nov 14 16:15:24 user nova-compute[75097]:   </metadata>
Nov 14 16:15:24 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:15:24 user nova-compute[75097]:     <system>
Nov 14 16:15:24 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:15:24 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:15:24 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:15:24 user nova-compute[75097]:       <entry name="serial">f8d51b37-5f88-45f1-876b-99e387812c3c</entry>
Nov 14 16:15:24 user nova-compute[75097]:       <entry name="uuid">f8d51b37-5f88-45f1-876b-99e387812c3c</entry>
Nov 14 16:15:24 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:15:24 user nova-compute[75097]:     </system>
Nov 14 16:15:24 user nova-compute[75097]:   </sysinfo>
Nov 14 16:15:24 user nova-compute[75097]:   <os>
Nov 14 16:15:24 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:15:24 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:15:24 user nova-compute[75097]:   </os>
Nov 14 16:15:24 user nova-compute[75097]:   <features>
Nov 14 16:15:24 user nova-compute[75097]:     <acpi/>
Nov 14 16:15:24 user nova-compute[75097]:     <apic/>
Nov 14 16:15:24 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:15:24 user nova-compute[75097]:   </features>
Nov 14 16:15:24 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:15:24 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:15:24 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:15:24 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:15:24 user nova-compute[75097]:   </clock>
Nov 14 16:15:24 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:15:24 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:15:24 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:15:24 user nova-compute[75097]:   </cpu>
Nov 14 16:15:24 user nova-compute[75097]:   <devices>
Nov 14 16:15:24 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:15:24 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:15:24 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:15:24 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:15:24 user nova-compute[75097]:       <serial>ffbabaed-6d22-46f9-9649-e87681a00f73</serial>
Nov 14 16:15:24 user nova-compute[75097]:     </disk>
Nov 14 16:15:24 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:15:24 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:15:24 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue"/>
Nov 14 16:15:24 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:15:24 user nova-compute[75097]:       <boot order="1"/>
Nov 14 16:15:24 user nova-compute[75097]:     </disk>
Nov 14 16:15:24 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:15:24 user nova-compute[75097]:       <mac address="fa:16:3e:0f:90:a8"/>
Nov 14 16:15:24 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:15:24 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:15:24 user nova-compute[75097]:       <target dev="tap1db5225e-74"/>
Nov 14 16:15:24 user nova-compute[75097]:     </interface>
Nov 14 16:15:24 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:15:24 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/console.log" append="off"/>
Nov 14 16:15:24 user nova-compute[75097]:     </serial>
Nov 14 16:15:24 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:15:24 user nova-compute[75097]:     <video>
Nov 14 16:15:24 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:15:24 user nova-compute[75097]:     </video>
Nov 14 16:15:24 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:15:24 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:15:24 user nova-compute[75097]:     </rng>
Nov 14 16:15:24 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:15:24 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:15:24 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:15:24 user nova-compute[75097]:     </memballoon>
Nov 14 16:15:24 user nova-compute[75097]:   </devices>
Nov 14 16:15:24 user nova-compute[75097]: </domain>
Nov 14 16:15:24 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:15:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance destroyed successfully.
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:15:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No VIF found with MAC fa:16:3e:0f:90:a8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:15:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-049dcd0f-70c4-47f7-b4c4-e50578a63168 req-6cd5c4f4-bae9-46aa-9fb6-5518ce8cb4ff service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-049dcd0f-70c4-47f7-b4c4-e50578a63168 req-6cd5c4f4-bae9-46aa-9fb6-5518ce8cb4ff service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-049dcd0f-70c4-47f7-b4c4-e50578a63168 req-6cd5c4f4-bae9-46aa-9fb6-5518ce8cb4ff service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-049dcd0f-70c4-47f7-b4c4-e50578a63168 req-6cd5c4f4-bae9-46aa-9fb6-5518ce8cb4ff service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-049dcd0f-70c4-47f7-b4c4-e50578a63168 req-6cd5c4f4-bae9-46aa-9fb6-5518ce8cb4ff service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:26 user nova-compute[75097]: WARNING nova.compute.manager [req-049dcd0f-70c4-47f7-b4c4-e50578a63168 req-6cd5c4f4-bae9-46aa-9fb6-5518ce8cb4ff service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state active and task_state rescuing.
Nov 14 16:15:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-61bcfc56-1318-4c1f-9d56-14929790c9bf tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:15:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-8fd70481-6ade-4819-a2f4-01eaa3286bf2 req-2ad7f8cb-1c91-475f-98e4-39088de6c005 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8fd70481-6ade-4819-a2f4-01eaa3286bf2 req-2ad7f8cb-1c91-475f-98e4-39088de6c005 service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8fd70481-6ade-4819-a2f4-01eaa3286bf2 req-2ad7f8cb-1c91-475f-98e4-39088de6c005 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8fd70481-6ade-4819-a2f4-01eaa3286bf2 req-2ad7f8cb-1c91-475f-98e4-39088de6c005 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-8fd70481-6ade-4819-a2f4-01eaa3286bf2 req-2ad7f8cb-1c91-475f-98e4-39088de6c005 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:28 user nova-compute[75097]: WARNING nova.compute.manager [req-8fd70481-6ade-4819-a2f4-01eaa3286bf2 req-2ad7f8cb-1c91-475f-98e4-39088de6c005 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state active and task_state rescuing.
Nov 14 16:15:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:15:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:40 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:15:40 user nova-compute[75097]: INFO nova.compute.claims [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Claim successful on node user
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.059s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:15:41 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.policy [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac22930f0fb94bfbabe013f477e056ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73525a2ed1ed475994a7d12cf23aa81f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:15:41 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Creating image(s)
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "/opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "/opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:41 user nova-compute[75097]: INFO nova.compute.manager [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Terminating instance
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-458c8a3f-4608-4938-b1cb-7209eda25dd1 req-4b486a79-77d3-4c8e-9264-25883bc48f1d service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-458c8a3f-4608-4938-b1cb-7209eda25dd1 req-4b486a79-77d3-4c8e-9264-25883bc48f1d service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-458c8a3f-4608-4938-b1cb-7209eda25dd1 req-4b486a79-77d3-4c8e-9264-25883bc48f1d service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-458c8a3f-4608-4938-b1cb-7209eda25dd1 req-4b486a79-77d3-4c8e-9264-25883bc48f1d service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-458c8a3f-4608-4938-b1cb-7209eda25dd1 req-4b486a79-77d3-4c8e-9264-25883bc48f1d service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-458c8a3f-4608-4938-b1cb-7209eda25dd1 req-4b486a79-77d3-4c8e-9264-25883bc48f1d service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-unplugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk 1073741824" returned: 0 in 0.052s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:41 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Successfully created port: 3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Cannot resize image /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Ensure instance console log exists: /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:42 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Instance destroyed successfully.
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'resources' on Instance uuid 44342db6-8756-46db-a279-0557c24e5d2d {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1796443693',display_name='tempest-ServerRescueNegativeTestJSON-server-1796443693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1796443693',id=24,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44dvZEELnb9RBytVGxDZvUPg76aN5i6tmwXWvRLUdI4cvikCU64842EES4HipdVTEqUy9GdUaB2rD/dqtGhF5f1kq4ZRAvnlrXclgvtE2WKLELATAZ+AL5UNWlJ9Q2KQ==',key_name='tempest-keypair-2030503793',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:11:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-gvdr15to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:13:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=44342db6-8756-46db-a279-0557c24e5d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "dbed1766-e24b-471a-9559-c738f87ed9cb", "address": "fa:16:3e:6d:ff:4d", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbed1766-e2", "ovs_interfaceid": "dbed1766-e24b-471a-9559-c738f87ed9cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG os_vif [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbed1766-e2, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de31785b-78f0-4814-85fa-8c31c7024acd) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:42 user nova-compute[75097]: INFO os_vif [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=dbed1766-e24b-471a-9559-c738f87ed9cb,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbed1766-e2')
Nov 14 16:15:42 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Deleting instance files /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d_del
Nov 14 16:15:42 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Deletion of /opt/stack/data/nova/instances/44342db6-8756-46db-a279-0557c24e5d2d_del complete
Nov 14 16:15:42 user nova-compute[75097]: INFO nova.compute.manager [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:42 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Successfully updated port: 3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquired lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received event network-changed-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Refreshing instance network info cache due to event network-changed-3998dd10-a0a1-4b78-a5b4-8b505491676e. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] Acquiring lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid '44342db6-8756-46db-a279-0557c24e5d2d' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid '44342db6-8756-46db-a279-0557c24e5d2d' (instance-00000018)
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:43 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Took 1.14 seconds to deallocate network for instance.
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updating instance_info_cache with network_info: [{"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] Acquiring lock "44342db6-8756-46db-a279-0557c24e5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] Lock "44342db6-8756-46db-a279-0557c24e5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] No waiting events found dispatching network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:43 user nova-compute[75097]: WARNING nova.compute.manager [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received unexpected event network-vif-plugged-dbed1766-e24b-471a-9559-c738f87ed9cb for instance with vm_state deleted and task_state None.
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-7382c574-1ad5-403a-ad74-57cfe40baaf0 req-4f7ca810-34f4-4cd4-8382-30d4c1a0573f service nova] [instance: 44342db6-8756-46db-a279-0557c24e5d2d] Received event network-vif-deleted-dbed1766-e24b-471a-9559-c738f87ed9cb {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Releasing lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Instance network_info: |[{"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] Acquired lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Refreshing network info cache for port 3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Start _get_guest_xml network_info=[{"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:15:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:15:43 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:15:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-622117802',display_name='tempest-AttachVolumeNegativeTest-server-622117802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-622117802',id=30,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaojfK50JEt3l9PYZxIo+pD/g9EgmFMV0J1l6V8y/qZYWAVLzJXlk/aEeigll1PopZpBiTicUv5w7oPDULnsG/4jftTWKncar7QWw8WADgPz7JyASTt3kNX/44jAO49Rw==',key_name='tempest-keypair-1204426257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-zo9grokp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=77e94c18-d8e8-48b0-a421-0dae51fe4778,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'pci_devices' on Instance uuid 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:15:43 user nova-compute[75097]:   <uuid>77e94c18-d8e8-48b0-a421-0dae51fe4778</uuid>
Nov 14 16:15:43 user nova-compute[75097]:   <name>instance-0000001e</name>
Nov 14 16:15:43 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:15:43 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:15:43 user nova-compute[75097]:   <metadata>
Nov 14 16:15:43 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:15:43 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:15:43 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeNegativeTest-server-622117802</nova:name>
Nov 14 16:15:43 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:15:43</nova:creationTime>
Nov 14 16:15:43 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:15:43 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:15:43 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:15:43 user nova-compute[75097]:       <nova:owner>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:user uuid="ac22930f0fb94bfbabe013f477e056ca">tempest-AttachVolumeNegativeTest-907754384-project-member</nova:user>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:project uuid="73525a2ed1ed475994a7d12cf23aa81f">tempest-AttachVolumeNegativeTest-907754384</nova:project>
Nov 14 16:15:43 user nova-compute[75097]:       </nova:owner>
Nov 14 16:15:43 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:15:43 user nova-compute[75097]:       <nova:ports>
Nov 14 16:15:43 user nova-compute[75097]:         <nova:port uuid="3998dd10-a0a1-4b78-a5b4-8b505491676e">
Nov 14 16:15:43 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 16:15:43 user nova-compute[75097]:         </nova:port>
Nov 14 16:15:43 user nova-compute[75097]:       </nova:ports>
Nov 14 16:15:43 user nova-compute[75097]:     </nova:instance>
Nov 14 16:15:43 user nova-compute[75097]:   </metadata>
Nov 14 16:15:43 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:15:43 user nova-compute[75097]:     <system>
Nov 14 16:15:43 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:15:43 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:15:43 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:15:43 user nova-compute[75097]:       <entry name="serial">77e94c18-d8e8-48b0-a421-0dae51fe4778</entry>
Nov 14 16:15:43 user nova-compute[75097]:       <entry name="uuid">77e94c18-d8e8-48b0-a421-0dae51fe4778</entry>
Nov 14 16:15:43 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:15:43 user nova-compute[75097]:     </system>
Nov 14 16:15:43 user nova-compute[75097]:   </sysinfo>
Nov 14 16:15:43 user nova-compute[75097]:   <os>
Nov 14 16:15:43 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:15:43 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:15:43 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:15:43 user nova-compute[75097]:   </os>
Nov 14 16:15:43 user nova-compute[75097]:   <features>
Nov 14 16:15:43 user nova-compute[75097]:     <acpi/>
Nov 14 16:15:43 user nova-compute[75097]:     <apic/>
Nov 14 16:15:43 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:15:43 user nova-compute[75097]:   </features>
Nov 14 16:15:43 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:15:43 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:15:43 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:15:43 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:15:43 user nova-compute[75097]:   </clock>
Nov 14 16:15:43 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:15:43 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:15:43 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:15:43 user nova-compute[75097]:   </cpu>
Nov 14 16:15:43 user nova-compute[75097]:   <devices>
Nov 14 16:15:43 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:15:43 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:15:43 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk"/>
Nov 14 16:15:43 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:15:43 user nova-compute[75097]:     </disk>
Nov 14 16:15:43 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:15:43 user nova-compute[75097]:       <mac address="fa:16:3e:a7:a6:39"/>
Nov 14 16:15:43 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:15:43 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:15:43 user nova-compute[75097]:       <target dev="tap3998dd10-a0"/>
Nov 14 16:15:43 user nova-compute[75097]:     </interface>
Nov 14 16:15:43 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:15:43 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/console.log" append="off"/>
Nov 14 16:15:43 user nova-compute[75097]:     </serial>
Nov 14 16:15:43 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:15:43 user nova-compute[75097]:     <video>
Nov 14 16:15:43 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:15:43 user nova-compute[75097]:     </video>
Nov 14 16:15:43 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:15:43 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:15:43 user nova-compute[75097]:     </rng>
Nov 14 16:15:43 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:15:43 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:15:43 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:15:43 user nova-compute[75097]:     </memballoon>
Nov 14 16:15:43 user nova-compute[75097]:   </devices>
Nov 14 16:15:43 user nova-compute[75097]: </domain>
Nov 14 16:15:43 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:15:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-622117802',display_name='tempest-AttachVolumeNegativeTest-server-622117802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-622117802',id=30,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaojfK50JEt3l9PYZxIo+pD/g9EgmFMV0J1l6V8y/qZYWAVLzJXlk/aEeigll1PopZpBiTicUv5w7oPDULnsG/4jftTWKncar7QWw8WADgPz7JyASTt3kNX/44jAO49Rw==',key_name='tempest-keypair-1204426257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-zo9grokp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=77e94c18-d8e8-48b0-a421-0dae51fe4778,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG os_vif [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fbbec1d-bd8d-5a4e-ae5d-7f3292688db5', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3998dd10-a0, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3998dd10-a0, col_values=(('qos', UUID('bdc4cbf7-63b4-4040-afd9-903a24026703')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3998dd10-a0, col_values=(('external_ids', {'iface-id': '3998dd10-a0a1-4b78-a5b4-8b505491676e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:a6:39', 'vm-uuid': '77e94c18-d8e8-48b0-a421-0dae51fe4778'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:44 user nova-compute[75097]: INFO os_vif [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0')
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:a7:a6:39, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:44 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Deleted allocations for instance 44342db6-8756-46db-a279-0557c24e5d2d
Nov 14 16:15:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:15:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8106MB free_disk=25.08343505859375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updated VIF entry in instance network info cache for port 3998dd10-a0a1-4b78-a5b4-8b505491676e. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updating instance_info_cache with network_info: [{"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d4ada17b-89c2-4d08-85e9-926fab716f80 req-770c9ea2-5fb6-4a7a-9566-f02551a0b24a service nova] Releasing lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad701cb6-ead5-42d3-954c-105bc8ef6916 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "44342db6-8756-46db-a279-0557c24e5d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.150s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Applying migration context for instance ec6aa836-f4e8-4001-8273-6782614acfb8 as it has an incoming, in-progress migration 99c7739e-8713-46b1-9093-d780c33002a7. Migration status is finished {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 16:15:44 user nova-compute[75097]: INFO nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating resource usage from migration 99c7739e-8713-46b1-9093-d780c33002a7
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f6935556-dbaa-46f3-864b-73d26c5fcbf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Migration 99c7739e-8713-46b1-9093-d780c33002a7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:15:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received event network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] No waiting events found dispatching network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:45 user nova-compute[75097]: WARNING nova.compute.manager [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received unexpected event network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e for instance with vm_state building and task_state spawning.
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received event network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] No waiting events found dispatching network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:15:45 user nova-compute[75097]: WARNING nova.compute.manager [req-4d96abe4-ecc2-4626-93a6-fac66814200c req-d89e63cb-a437-4c4e-a9f9-48468d56b7fa service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received unexpected event network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e for instance with vm_state building and task_state spawning.
Nov 14 16:15:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:15:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Instance spawned successfully.
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:15:47 user nova-compute[75097]: INFO nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 14 16:15:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:15:47 user nova-compute[75097]: INFO nova.compute.manager [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Took 6.96 seconds to build instance.
Nov 14 16:15:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3e08bb34-032f-445f-b056-f5095c723822 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.061s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'flavor' on Instance uuid 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:48 user nova-compute[75097]: INFO nova.compute.manager [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Attaching volume 3e14f7ab-b0a3-404c-890b-69032452c8f7 to /dev/vdb
Nov 14 16:15:49 user nova-compute[75097]: DEBUG os_brick.utils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dbc263-9291-4a66-b7cf-018ed90104d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a34b31-8c6e-4d0c-bb99-a9a42432f7eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85d898-3e3c-4f2c-92bb-b4ea7904a76b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7869d8-dae6-4aaa-a123-bd6e6fc21131]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:15:49 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffd3a82-7cee-417c-9a1f-8f3dd8ec6c11]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG os_brick.utils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating existing volume attachment record: cf94fe51-9962-478c-a888-3695c8723694 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [{"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-f6935556-dbaa-46f3-864b-73d26c5fcbf2" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:15:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:15:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Going to confirm migration 2 {{(pid=75097) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquired lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:15:53 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'info_cache' on Instance uuid ec6aa836-f4e8-4001-8273-6782614acfb8 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [{"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Releasing lock "refresh_cache-ec6aa836-f4e8-4001-8273-6782614acfb8" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'migration_context' on Instance uuid ec6aa836-f4e8-4001-8273-6782614acfb8 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG nova.objects.base [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Object Instance<ec6aa836-f4e8-4001-8273-6782614acfb8> lazy-loaded attributes: info_cache,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHzmayuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:15:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:15:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:15:54 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e126edbb-aab9-4867-b9cf-76306a7bffc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:15:54 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc509b5-91bf-4b4d-8352-416f2074ab20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7] added
Nov 14 16:15:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8682bbd8-514f-4260-a320-d8993cd90f9b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.361s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd102900-dc8c-4105-aa1b-8a2cc6b9ddcd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHzmayuE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHzmayuE" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e87698d-3138-41f5-819d-13b63546e4ab]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHzmayuE'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[293dcb52-2fc4-4eae-ba35-a0d28a646f16]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[963dcbd2-efe9-4f26-a711-b5acaf7fe5f2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10704fb-6f5c-44ed-bed8-c947b28ecc70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260]
Nov 14 16:15:54 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260] successful.
Nov 14 16:15:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Deleted allocation for migration 99c7739e-8713-46b1-9093-d780c33002a7
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[491cb4de-fa46-4714-89e3-e6a928fc26ff]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812fa97-8b88-4d39-9083-d67201ece855]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:15:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c5a8a-b77f-455e-9903-361df2a6f093]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:15:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1baf20f0-5d7e-4ab8-a5b8-396e43aef1c9 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.659s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHzmayuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26463306264303563', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463306264303563', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'flavor' on Instance uuid 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:15:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:15:55 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:15:55 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:15:55 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:15:55 user nova-compute[75097]:   <serial>3e14f7ab-b0a3-404c-890b-69032452c8f7</serial>
Nov 14 16:15:55 user nova-compute[75097]: </disk>
Nov 14 16:15:55 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:15:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:15:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:15:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] No VIF found with MAC fa:16:3e:3d:62:22, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:15:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c277059c-3c1c-4d0d-b633-1a426fd0c8dc tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.495s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:15:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:15:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing instance network info cache due to event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:15:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:15:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:15:58 user nova-compute[75097]: DEBUG nova.network.neutron [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:15:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:15:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updated VIF entry in instance network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:15:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:15:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0e7a3f81-15f9-4b72-8a38-81bf1911dd3d req-54c3da65-1ed5-4b51-9bd7-b4d288ba8064 service nova] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing instance network info cache due to event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updated VIF entry in instance network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:01 user nova-compute[75097]: INFO nova.compute.manager [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Rebooting instance
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0dfb40aa-5a90-4d62-960c-0fafe19a50a4 req-430f83b5-3589-47bf-b796-085cc9e9ba41 service nova] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:16:01 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:16:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:16:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:16:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-031409c2-d234-451e-b794-7a0de67a03b0 req-53220988-e8a1-48dc-ae08-3ca22948dd97 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-unplugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-031409c2-d234-451e-b794-7a0de67a03b0 req-53220988-e8a1-48dc-ae08-3ca22948dd97 service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-031409c2-d234-451e-b794-7a0de67a03b0 req-53220988-e8a1-48dc-ae08-3ca22948dd97 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-031409c2-d234-451e-b794-7a0de67a03b0 req-53220988-e8a1-48dc-ae08-3ca22948dd97 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-031409c2-d234-451e-b794-7a0de67a03b0 req-53220988-e8a1-48dc-ae08-3ca22948dd97 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-unplugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:16:04 user nova-compute[75097]: WARNING nova.compute.manager [req-031409c2-d234-451e-b794-7a0de67a03b0 req-53220988-e8a1-48dc-ae08-3ca22948dd97 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-unplugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state active and task_state reboot_started.
Nov 14 16:16:05 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance shutdown successfully.
Nov 14 16:16:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:16:06 user nova-compute[75097]: WARNING nova.compute.manager [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state active and task_state reboot_started.
Nov 14 16:16:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:16:06 user nova-compute[75097]: WARNING nova.compute.manager [req-ec573306-ac84-4bf7-b3e9-340126fd3430 req-51dee659-b635-4e1a-9f88-c1ae66259dbb service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state active and task_state reboot_started.
Nov 14 16:16:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:08 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance running successfully.
Nov 14 16:16:08 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance soft rebooted successfully.
Nov 14 16:16:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:16:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28275c15-6614-44a9-8ab0-c5288857860d tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.056s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c8595a5-5d11-4a53-b082-4e169b0d62d4 req-d4565e87-a2f3-44a3-90eb-3e74e9b19b01 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c8595a5-5d11-4a53-b082-4e169b0d62d4 req-d4565e87-a2f3-44a3-90eb-3e74e9b19b01 service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c8595a5-5d11-4a53-b082-4e169b0d62d4 req-d4565e87-a2f3-44a3-90eb-3e74e9b19b01 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c8595a5-5d11-4a53-b082-4e169b0d62d4 req-d4565e87-a2f3-44a3-90eb-3e74e9b19b01 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c8595a5-5d11-4a53-b082-4e169b0d62d4 req-d4565e87-a2f3-44a3-90eb-3e74e9b19b01 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:16:08 user nova-compute[75097]: WARNING nova.compute.manager [req-0c8595a5-5d11-4a53-b082-4e169b0d62d4 req-d4565e87-a2f3-44a3-90eb-3e74e9b19b01 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state active and task_state None.
Nov 14 16:16:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:16:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:16:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:37 user nova-compute[75097]: INFO nova.compute.manager [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Terminating instance
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-abda7cc9-5566-4425-b371-739712ab2205 req-60df319c-a7fa-4afd-a1b0-f5414c1d5edc service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-unplugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-abda7cc9-5566-4425-b371-739712ab2205 req-60df319c-a7fa-4afd-a1b0-f5414c1d5edc service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-abda7cc9-5566-4425-b371-739712ab2205 req-60df319c-a7fa-4afd-a1b0-f5414c1d5edc service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-abda7cc9-5566-4425-b371-739712ab2205 req-60df319c-a7fa-4afd-a1b0-f5414c1d5edc service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-abda7cc9-5566-4425-b371-739712ab2205 req-60df319c-a7fa-4afd-a1b0-f5414c1d5edc service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-unplugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-abda7cc9-5566-4425-b371-739712ab2205 req-60df319c-a7fa-4afd-a1b0-f5414c1d5edc service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-unplugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:16:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Instance destroyed successfully.
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'resources' on Instance uuid f6935556-dbaa-46f3-864b-73d26c5fcbf2 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-276102445',display_name='tempest-ServerRescueNegativeTestJSON-server-276102445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-276102445',id=4,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-j0e00lv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:02:36Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=f6935556-dbaa-46f3-864b-73d26c5fcbf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "address": "fa:16:3e:85:3f:71", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9296ab82-d1", "ovs_interfaceid": "9296ab82-d1f4-4a32-b252-c7cb9d091a30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG os_vif [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9296ab82-d1, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83b42986-edff-4946-9ee3-a65830a5750e) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:37 user nova-compute[75097]: INFO os_vif [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:3f:71,bridge_name='br-int',has_traffic_filtering=True,id=9296ab82-d1f4-4a32-b252-c7cb9d091a30,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9296ab82-d1')
Nov 14 16:16:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Deleting instance files /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2_del
Nov 14 16:16:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Deletion of /opt/stack/data/nova/instances/f6935556-dbaa-46f3-864b-73d26c5fcbf2_del complete
Nov 14 16:16:37 user nova-compute[75097]: INFO nova.compute.manager [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 16:16:37 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:16:37 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:16:38 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:16:38 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Took 0.46 seconds to deallocate network for instance.
Nov 14 16:16:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-f2825fc1-4b60-4cbd-bbbe-386c8fc6d4f3 req-cc8a20ff-5d3d-48d2-8b1c-311fea02b3a5 service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-deleted-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:38 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:16:38 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:16:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:38 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Deleted allocations for instance f6935556-dbaa-46f3-864b-73d26c5fcbf2
Nov 14 16:16:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d6387c98-b072-4cac-9f83-fb67b8c2fe58 tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.656s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-40b07dbd-c02a-49e5-932f-1f0acad52873 req-4756bc1b-45ad-4a91-a990-819c38141a4a service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:16:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40b07dbd-c02a-49e5-932f-1f0acad52873 req-4756bc1b-45ad-4a91-a990-819c38141a4a service nova] Acquiring lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40b07dbd-c02a-49e5-932f-1f0acad52873 req-4756bc1b-45ad-4a91-a990-819c38141a4a service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40b07dbd-c02a-49e5-932f-1f0acad52873 req-4756bc1b-45ad-4a91-a990-819c38141a4a service nova] Lock "f6935556-dbaa-46f3-864b-73d26c5fcbf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-40b07dbd-c02a-49e5-932f-1f0acad52873 req-4756bc1b-45ad-4a91-a990-819c38141a4a service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] No waiting events found dispatching network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:16:39 user nova-compute[75097]: WARNING nova.compute.manager [req-40b07dbd-c02a-49e5-932f-1f0acad52873 req-4756bc1b-45ad-4a91-a990-819c38141a4a service nova] [instance: f6935556-dbaa-46f3-864b-73d26c5fcbf2] Received unexpected event network-vif-plugged-9296ab82-d1f4-4a32-b252-c7cb9d091a30 for instance with vm_state deleted and task_state None.
Nov 14 16:16:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:16:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:16:46 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:16:46 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=25.107891082763672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance b524df86-e1ec-4255-ba03-e8a314560af9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:46 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:16:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:16:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [{"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:16:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:16:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:16:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:17:11 user nova-compute[75097]: INFO nova.compute.manager [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Unrescuing
Nov 14 16:17:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:17:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:17:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'flavor' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-527f130b-1c40-412a-ae10-01308f7f8d71 req-098ba5db-979e-4197-bc2b-e342d80ddba2 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-527f130b-1c40-412a-ae10-01308f7f8d71 req-098ba5db-979e-4197-bc2b-e342d80ddba2 service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-527f130b-1c40-412a-ae10-01308f7f8d71 req-098ba5db-979e-4197-bc2b-e342d80ddba2 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-527f130b-1c40-412a-ae10-01308f7f8d71 req-098ba5db-979e-4197-bc2b-e342d80ddba2 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-527f130b-1c40-412a-ae10-01308f7f8d71 req-098ba5db-979e-4197-bc2b-e342d80ddba2 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:17:12 user nova-compute[75097]: WARNING nova.compute.manager [req-527f130b-1c40-412a-ae10-01308f7f8d71 req-098ba5db-979e-4197-bc2b-e342d80ddba2 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance destroyed successfully.
Nov 14 16:17:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:17:14 user nova-compute[75097]: WARNING nova.compute.manager [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:17:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:17:14 user nova-compute[75097]: WARNING nova.compute.manager [req-f89dd062-86ec-489e-959c-ba592243727a req-4ff9d8a9-a051-4323-8f71-9298de037cae service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:17:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b8444bc0-864b-4e59-9d25-db7fe3029c6d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:17:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-f49b98d8-917d-406e-ae64-08be022adaa2 req-4e092e30-5c3b-4030-bfe3-adeb5fbd6437 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f49b98d8-917d-406e-ae64-08be022adaa2 req-4e092e30-5c3b-4030-bfe3-adeb5fbd6437 service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f49b98d8-917d-406e-ae64-08be022adaa2 req-4e092e30-5c3b-4030-bfe3-adeb5fbd6437 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f49b98d8-917d-406e-ae64-08be022adaa2 req-4e092e30-5c3b-4030-bfe3-adeb5fbd6437 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-f49b98d8-917d-406e-ae64-08be022adaa2 req-4e092e30-5c3b-4030-bfe3-adeb5fbd6437 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:17:16 user nova-compute[75097]: WARNING nova.compute.manager [req-f49b98d8-917d-406e-ae64-08be022adaa2 req-4e092e30-5c3b-4030-bfe3-adeb5fbd6437 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state active and task_state None.
Nov 14 16:17:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "b524df86-e1ec-4255-ba03-e8a314560af9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:27 user nova-compute[75097]: INFO nova.compute.manager [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Terminating instance
Nov 14 16:17:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-998c4f60-50ec-4a93-bd17-14530c15bf9b req-b6b4f371-c3f1-446b-bc98-8a84477b1360 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-998c4f60-50ec-4a93-bd17-14530c15bf9b req-b6b4f371-c3f1-446b-bc98-8a84477b1360 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-998c4f60-50ec-4a93-bd17-14530c15bf9b req-b6b4f371-c3f1-446b-bc98-8a84477b1360 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-998c4f60-50ec-4a93-bd17-14530c15bf9b req-b6b4f371-c3f1-446b-bc98-8a84477b1360 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-998c4f60-50ec-4a93-bd17-14530c15bf9b req-b6b4f371-c3f1-446b-bc98-8a84477b1360 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-998c4f60-50ec-4a93-bd17-14530c15bf9b req-b6b4f371-c3f1-446b-bc98-8a84477b1360 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-unplugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Instance destroyed successfully.
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lazy-loading 'resources' on Instance uuid b524df86-e1ec-4255-ba03-e8a314560af9 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1146543409',display_name='tempest-ServerRescueNegativeTestJSON-server-1146543409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1146543409',id=3,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e20e537274874bd3e0236eca9629f',ramdisk_id='',reservation_id='r-ibox19u8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2084860496',owner_user_name='tempest-ServerRescueNegativeTestJSON-2084860496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:07:18Z,user_data=None,user_id='a0d1946be4a442eb9b3bc8343510f656',uuid=b524df86-e1ec-4255-ba03-e8a314560af9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converting VIF {"id": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "address": "fa:16:3e:4b:53:26", "network": {"id": "ad50b710-d965-4cec-851c-f1e6092206e1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151751143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e20e537274874bd3e0236eca9629f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfb88ebb-98", "ovs_interfaceid": "bfb88ebb-9839-4650-a9c3-04f44b9f3310", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG os_vif [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfb88ebb-98, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e4164c4-99f9-4558-85e1-3603d8f6ea12) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:28 user nova-compute[75097]: INFO os_vif [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:53:26,bridge_name='br-int',has_traffic_filtering=True,id=bfb88ebb-9839-4650-a9c3-04f44b9f3310,network=Network(ad50b710-d965-4cec-851c-f1e6092206e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfb88ebb-98')
Nov 14 16:17:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Deleting instance files /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9_del
Nov 14 16:17:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Deletion of /opt/stack/data/nova/instances/b524df86-e1ec-4255-ba03-e8a314560af9_del complete
Nov 14 16:17:28 user nova-compute[75097]: INFO nova.compute.manager [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 16:17:28 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:17:28 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:17:29 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Took 0.46 seconds to deallocate network for instance.
Nov 14 16:17:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:17:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:29 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Deleted allocations for instance b524df86-e1ec-4255-ba03-e8a314560af9
Nov 14 16:17:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5338fe18-4740-4f18-baf6-084260bca03b tempest-ServerRescueNegativeTestJSON-2084860496 tempest-ServerRescueNegativeTestJSON-2084860496-project-member] Lock "b524df86-e1ec-4255-ba03-e8a314560af9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] Acquiring lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] Lock "b524df86-e1ec-4255-ba03-e8a314560af9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] No waiting events found dispatching network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:17:30 user nova-compute[75097]: WARNING nova.compute.manager [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received unexpected event network-vif-plugged-bfb88ebb-9839-4650-a9c3-04f44b9f3310 for instance with vm_state deleted and task_state None.
Nov 14 16:17:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-0bcbcb18-cc54-4d34-b04f-b5053593568b req-2580d49a-238d-49d6-b454-313711638540 service nova] [instance: b524df86-e1ec-4255-ba03-e8a314560af9] Received event network-vif-deleted-bfb88ebb-9839-4650-a9c3-04f44b9f3310 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received event network-changed-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Refreshing instance network info cache due to event network-changed-3998dd10-a0a1-4b78-a5b4-8b505491676e. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] Acquiring lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] Acquired lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Refreshing network info cache for port 3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updated VIF entry in instance network info cache for port 3998dd10-a0a1-4b78-a5b4-8b505491676e. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updating instance_info_cache with network_info: [{"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:17:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85c7e56d-9980-48ce-b38a-7ee313bdd1ba req-bbdd00fd-df3e-4ba7-bb7b-679610fc66e3 service nova] Releasing lock "refresh_cache-77e94c18-d8e8-48b0-a421-0dae51fe4778" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:17:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:34 user nova-compute[75097]: INFO nova.compute.manager [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Attaching volume b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c to /dev/vdb
Nov 14 16:17:34 user nova-compute[75097]: DEBUG os_brick.utils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d052f95-3919-4142-9e16-9c0da0e9e82a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f187d64-b49e-4879-b495-99989929eb47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42edbef-b75f-488a-bfff-8d41e0d4be10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b607ef7b-9bb3-490f-b8cb-8bc605e7c785]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:17:34 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:17:34 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[524e0700-8f6c-4d51-866b-e9c81537d481]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG os_brick.utils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:17:34 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updating existing volume attachment record: e94a7c69-e3d9-4054-947f-373c4e870797 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:17:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid ec6aa836-f4e8-4001-8273-6782614acfb8 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PofbVYZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:17:38 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:17:38 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:17:38 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e484346d-c175-4d4a-a260-7b28995c8ee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:17:38 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd0e91b-d74c-41a1-a143-ca5b3e45ffe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c] added
Nov 14 16:17:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e623957-0bda-467b-ae0d-c59671be59a2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b102f-fdba-42b3-abfc-8ce4b964ae9c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PofbVYZQ {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PofbVYZQ" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e9ff9d-0533-484d-9259-64fb64b6e1c2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PofbVYZQ'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeacbc8-a79c-443b-8df3-703d290fc807]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83dc127-c1a3-4211-aecf-edecbf47d357]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee2094-c992-46fd-a5e0-de5be46c1c3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260]
Nov 14 16:17:38 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260] successful.
Nov 14 16:17:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3326394-79d9-408e-bb96-99a3b79d8516]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82fcd6-53b6-4c4f-bd41-31b5460f1954]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c (non-flash)
Nov 14 16:17:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:17:38 user nova-compute[75097]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c (non-flash)
Nov 14 16:17:38 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ab541-43f6-49f7-a1df-44384d1fb0f7]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:17:38 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PofbVYZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23866383362393731', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866383362393731', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG nova.objects.instance [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:17:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:17:39 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:17:39 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:17:39 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:17:39 user nova-compute[75097]:   <serial>b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c</serial>
Nov 14 16:17:39 user nova-compute[75097]: </disk>
Nov 14 16:17:39 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] No VIF found with MAC fa:16:3e:a7:a6:39, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-45aab605-1e4e-42b4-9318-5413a69c22a9 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.355s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.300s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:40 user nova-compute[75097]: INFO nova.compute.manager [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Detaching volume b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c
Nov 14 16:17:41 user nova-compute[75097]: INFO nova.virt.block_device [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Attempting to driver detach volume b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c from mountpoint /dev/vdb
Nov 14 16:17:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Attempting to detach device vdb from instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:17:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:17:41 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:17:41 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:17:41 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:17:41 user nova-compute[75097]:   <serial>b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c</serial>
Nov 14 16:17:41 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:17:41 user nova-compute[75097]: </disk>
Nov 14 16:17:41 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:17:41 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully detached device vdb from instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 from the persistent domain config.
Nov 14 16:17:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:17:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:17:41 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:17:41 user nova-compute[75097]:   <source dev="/dev/sde"/>
Nov 14 16:17:41 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:17:41 user nova-compute[75097]:   <serial>b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c</serial>
Nov 14 16:17:41 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:17:41 user nova-compute[75097]: </disk>
Nov 14 16:17:41 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:17:41 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:17:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:17:44 user nova-compute[75097]: INFO nova.compute.manager [None req-932f522e-1c19-44ff-8720-62217e28fa52 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Get console output
Nov 14 16:17:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:44 user nova-compute[75097]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:17:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:17:46 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:17:46 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8317MB free_disk=25.135604858398438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:17:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:17:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:17:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing instance network info cache due to event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updated VIF entry in instance network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a3faa846-5fb2-4b0c-861b-0590fb1d63c9 req-b6ab08cc-64fb-4d5e-8b23-5b0ce08dcda5 service nova] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:17:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:17:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:17:54 user nova-compute[75097]: INFO nova.compute.manager [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Detaching volume 3e14f7ab-b0a3-404c-890b-69032452c8f7
Nov 14 16:17:54 user nova-compute[75097]: INFO nova.virt.block_device [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Attempting to driver detach volume 3e14f7ab-b0a3-404c-890b-69032452c8f7 from mountpoint /dev/vdb
Nov 14 16:17:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Attempting to detach device vdb from instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:17:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:17:54 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:17:54 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:17:54 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:17:54 user nova-compute[75097]:   <serial>3e14f7ab-b0a3-404c-890b-69032452c8f7</serial>
Nov 14 16:17:54 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:17:54 user nova-compute[75097]: </disk>
Nov 14 16:17:54 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:17:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully detached device vdb from instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 from the persistent domain config.
Nov 14 16:17:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:17:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:17:54 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:17:54 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:17:54 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:17:54 user nova-compute[75097]:   <serial>3e14f7ab-b0a3-404c-890b-69032452c8f7</serial>
Nov 14 16:17:54 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:17:54 user nova-compute[75097]: </disk>
Nov 14 16:17:54 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:17:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing instance network info cache due to event network-changed-626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] Acquiring lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] Acquired lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG nova.network.neutron [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Refreshing network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG nova.network.neutron [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updated VIF entry in instance network info cache for port 626a93f6-6527-40e1-9042-8dfb9d5dff92. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG nova.network.neutron [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [{"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:17:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9b691f64-de71-40d6-b951-66c7d7267dc0 req-ba978f52-ca8f-4fd6-a159-dd2a05769a4f service nova] Releasing lock "refresh_cache-4fd98396-940a-4ee5-9ec8-4f64c8c73a53" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:17:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:17:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:17:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:01 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 is timed out.
Nov 14 16:18:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully detached device vdb from instance 77e94c18-d8e8-48b0-a421-0dae51fe4778 from the live domain config.
Nov 14 16:18:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PofbVYZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:18:01 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e44403-57f1-4653-8e43-964e87cdc2a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:18:01 user nova-compute[75097]: No targets found.
Nov 14 16:18:01 user nova-compute[75097]: iSNS:
Nov 14 16:18:01 user nova-compute[75097]: No targets found.
Nov 14 16:18:01 user nova-compute[75097]: STATIC:
Nov 14 16:18:01 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:18:01 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:01 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:01 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7
Nov 14 16:18:01 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:01 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:01 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c
Nov 14 16:18:01 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:01 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:01 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:18:01 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:01 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:01 user nova-compute[75097]: FIRMWARE:
Nov 14 16:18:01 user nova-compute[75097]: No targets found.
Nov 14 16:18:01 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:18:01 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:18:01 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a5f47-a3dc-4533-929f-ba51522005a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a194423-4429-4efa-87f7-c671a3ecbe3b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:18:01 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:18:01 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:18:01 user nova-compute[75097]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c (non-flash)
Nov 14 16:18:01 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:18:01 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:18:01 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:18:01 user nova-compute[75097]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c (non-flash)
Nov 14 16:18:01 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981d5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b146110-c114-41ce-a54e-1d250498ff29]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3223d-d717-4f3a-9eeb-2824d7cc74ae]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f974942-8cc8-477c-b60c-309cb70e2b23]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d12f0-df6d-4796-96a6-302f0b8a98be]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19159c50-fb47-488f-93cc-1ee3606b5222]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8dd63e-9028-4c42-8ab4-61aa98038cdd]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260]
Nov 14 16:18:01 user nova-compute[75097]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c, portal: 172.16.0.220,3260] successful.
Nov 14 16:18:01 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2cd1b41-0601-4b52-8b2f-bfee4ea2e29c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a8919-2452-4ffa-939e-8da47755e0b6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] <== disconnect_volume: return (315ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:18:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:18:02 user nova-compute[75097]: DEBUG nova.objects.instance [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'flavor' on Instance uuid 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:18:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-a82d39db-01bf-457a-bb2d-013a34221c40 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:18:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:18:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:18:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:14 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 is timed out.
Nov 14 16:18:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully detached device vdb from instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 from the live domain config.
Nov 14 16:18:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHzmayuE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:18:14 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b162ef-9de3-48b4-9e8a-3cd915cebe81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:18:14 user nova-compute[75097]: No targets found.
Nov 14 16:18:14 user nova-compute[75097]: iSNS:
Nov 14 16:18:14 user nova-compute[75097]: No targets found.
Nov 14 16:18:14 user nova-compute[75097]: STATIC:
Nov 14 16:18:14 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:18:14 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:14 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:14 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7
Nov 14 16:18:14 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:14 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:14 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:18:14 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:14 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:14 user nova-compute[75097]: FIRMWARE:
Nov 14 16:18:14 user nova-compute[75097]: No targets found.
Nov 14 16:18:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:18:14 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:18:14 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ffd6f2-731c-4355-839d-c5e0903b02be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee0dfa8-29fa-4b38-8638-ff0b2f17d0b2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:18:14 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:18:14 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:18:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:18:14 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:18:14 user nova-compute[75097]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 (non-flash)
Nov 14 16:18:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac52953-4546-47af-a186-cdc40c17ebc3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7608d0-b365-40ba-b583-d84e1be087e8]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[195574b1-6631-4fb8-82c7-f4452fd3218e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be4527d-0e63-4816-b2ed-01bf0a627530]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53422b83-97e8-4dee-9cf3-341c54c37f97]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f8dfe-d9aa-4a2e-95e0-9597447c97a6]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260]
Nov 14 16:18:14 user nova-compute[75097]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7, portal: 172.16.0.220,3260] successful.
Nov 14 16:18:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e14f7ab-b0a3-404c-890b-69032452c8f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc33ea60-f5e8-4f56-a151-654084678d5b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] <== disconnect_volume: return (269ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:18:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:18:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'flavor' on Instance uuid 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:18:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-361129e7-b3bc-4d3f-beab-dda9c6161121 tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.638s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:18:31 user nova-compute[75097]: INFO nova.compute.claims [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Claim successful on node user
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:31 user nova-compute[75097]: INFO nova.compute.manager [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Terminating instance
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:18:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.policy [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eff36d66033f4331aa582c9fd2eab626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b644535e1a5b431e830a9d0aa10294e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:18:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Creating image(s)
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk 1073741824" returned: 0 in 0.055s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Instance destroyed successfully.
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.objects.instance [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lazy-loading 'resources' on Instance uuid 77e94c18-d8e8-48b0-a421-0dae51fe4778 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:15:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-622117802',display_name='tempest-AttachVolumeNegativeTest-server-622117802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-622117802',id=30,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaojfK50JEt3l9PYZxIo+pD/g9EgmFMV0J1l6V8y/qZYWAVLzJXlk/aEeigll1PopZpBiTicUv5w7oPDULnsG/4jftTWKncar7QWw8WADgPz7JyASTt3kNX/44jAO49Rw==',key_name='tempest-keypair-1204426257',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:15:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73525a2ed1ed475994a7d12cf23aa81f',ramdisk_id='',reservation_id='r-zo9grokp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-907754384',owner_user_name='tempest-AttachVolumeNegativeTest-907754384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac22930f0fb94bfbabe013f477e056ca',uuid=77e94c18-d8e8-48b0-a421-0dae51fe4778,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converting VIF {"id": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "address": "fa:16:3e:a7:a6:39", "network": {"id": "cc3e823b-6558-4251-a420-a737681d3f0c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1415713835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73525a2ed1ed475994a7d12cf23aa81f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3998dd10-a0", "ovs_interfaceid": "3998dd10-a0a1-4b78-a5b4-8b505491676e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG os_vif [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3998dd10-a0, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdc4cbf7-63b4-4040-afd9-903a24026703) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:32 user nova-compute[75097]: INFO os_vif [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:a6:39,bridge_name='br-int',has_traffic_filtering=True,id=3998dd10-a0a1-4b78-a5b4-8b505491676e,network=Network(cc3e823b-6558-4251-a420-a737681d3f0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3998dd10-a0')
Nov 14 16:18:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Deleting instance files /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778_del
Nov 14 16:18:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Deletion of /opt/stack/data/nova/instances/77e94c18-d8e8-48b0-a421-0dae51fe4778_del complete
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Successfully created port: abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:18:32 user nova-compute[75097]: INFO nova.compute.manager [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.194s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Cannot resize image /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Ensure instance console log exists: /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-96124f50-59b2-4ee4-8ee8-9c6aa0db8979 req-a0e10c03-16f6-492a-b9fc-0fcab9f258a5 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received event network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-96124f50-59b2-4ee4-8ee8-9c6aa0db8979 req-a0e10c03-16f6-492a-b9fc-0fcab9f258a5 service nova] Acquiring lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-96124f50-59b2-4ee4-8ee8-9c6aa0db8979 req-a0e10c03-16f6-492a-b9fc-0fcab9f258a5 service nova] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-96124f50-59b2-4ee4-8ee8-9c6aa0db8979 req-a0e10c03-16f6-492a-b9fc-0fcab9f258a5 service nova] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-96124f50-59b2-4ee4-8ee8-9c6aa0db8979 req-a0e10c03-16f6-492a-b9fc-0fcab9f258a5 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] No waiting events found dispatching network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:32 user nova-compute[75097]: WARNING nova.compute.manager [req-96124f50-59b2-4ee4-8ee8-9c6aa0db8979 req-a0e10c03-16f6-492a-b9fc-0fcab9f258a5 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received unexpected event network-vif-plugged-3998dd10-a0a1-4b78-a5b4-8b505491676e for instance with vm_state active and task_state deleting.
Nov 14 16:18:32 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:32 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Took 0.78 seconds to deallocate network for instance.
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Successfully updated port: abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:33 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Deleted allocations for instance 77e94c18-d8e8-48b0-a421-0dae51fe4778
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing instance network info cache due to event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-80bc18c3-db55-451a-90d4-96649408d615 tempest-AttachVolumeNegativeTest-907754384 tempest-AttachVolumeNegativeTest-907754384-project-member] Lock "77e94c18-d8e8-48b0-a421-0dae51fe4778" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance network_info: |[{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Start _get_guest_xml network_info=[{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:18:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:18:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026740153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026740153',id=31,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJkJneQF8jADu23T7xukX6Erw1pMtRbIZCg7OEWsueJmWMzA9BASjxEjDDdgfVmTW4dgloXHpY97nUgQr619DW50mqIGnxGd42NZ34QRB6CV4B9aBclkM4t/xIgYEdEA==',key_name='tempest-keypair-1809749550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-r2hzputd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=ba5d73ac-e962-4121-80c1-4d48077851ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'pci_devices' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:18:33 user nova-compute[75097]:   <uuid>ba5d73ac-e962-4121-80c1-4d48077851ab</uuid>
Nov 14 16:18:33 user nova-compute[75097]:   <name>instance-0000001f</name>
Nov 14 16:18:33 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:18:33 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:18:33 user nova-compute[75097]:   <metadata>
Nov 14 16:18:33 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:18:33 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:18:33 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1026740153</nova:name>
Nov 14 16:18:33 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:18:33</nova:creationTime>
Nov 14 16:18:33 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:18:33 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:18:33 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:18:33 user nova-compute[75097]:       <nova:owner>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:user uuid="eff36d66033f4331aa582c9fd2eab626">tempest-AttachVolumeShelveTestJSON-347532404-project-member</nova:user>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:project uuid="b644535e1a5b431e830a9d0aa10294e3">tempest-AttachVolumeShelveTestJSON-347532404</nova:project>
Nov 14 16:18:33 user nova-compute[75097]:       </nova:owner>
Nov 14 16:18:33 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:18:33 user nova-compute[75097]:       <nova:ports>
Nov 14 16:18:33 user nova-compute[75097]:         <nova:port uuid="abc26054-33f4-4cd1-8038-2d0737b45add">
Nov 14 16:18:33 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:18:33 user nova-compute[75097]:         </nova:port>
Nov 14 16:18:33 user nova-compute[75097]:       </nova:ports>
Nov 14 16:18:33 user nova-compute[75097]:     </nova:instance>
Nov 14 16:18:33 user nova-compute[75097]:   </metadata>
Nov 14 16:18:33 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:18:33 user nova-compute[75097]:     <system>
Nov 14 16:18:33 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:18:33 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:18:33 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:18:33 user nova-compute[75097]:       <entry name="serial">ba5d73ac-e962-4121-80c1-4d48077851ab</entry>
Nov 14 16:18:33 user nova-compute[75097]:       <entry name="uuid">ba5d73ac-e962-4121-80c1-4d48077851ab</entry>
Nov 14 16:18:33 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:18:33 user nova-compute[75097]:     </system>
Nov 14 16:18:33 user nova-compute[75097]:   </sysinfo>
Nov 14 16:18:33 user nova-compute[75097]:   <os>
Nov 14 16:18:33 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:18:33 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:18:33 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:18:33 user nova-compute[75097]:   </os>
Nov 14 16:18:33 user nova-compute[75097]:   <features>
Nov 14 16:18:33 user nova-compute[75097]:     <acpi/>
Nov 14 16:18:33 user nova-compute[75097]:     <apic/>
Nov 14 16:18:33 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:18:33 user nova-compute[75097]:   </features>
Nov 14 16:18:33 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:18:33 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:18:33 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:18:33 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:18:33 user nova-compute[75097]:   </clock>
Nov 14 16:18:33 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:18:33 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:18:33 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:18:33 user nova-compute[75097]:   </cpu>
Nov 14 16:18:33 user nova-compute[75097]:   <devices>
Nov 14 16:18:33 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:18:33 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:18:33 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk"/>
Nov 14 16:18:33 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:18:33 user nova-compute[75097]:     </disk>
Nov 14 16:18:33 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:18:33 user nova-compute[75097]:       <mac address="fa:16:3e:39:10:31"/>
Nov 14 16:18:33 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:18:33 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:18:33 user nova-compute[75097]:       <target dev="tapabc26054-33"/>
Nov 14 16:18:33 user nova-compute[75097]:     </interface>
Nov 14 16:18:33 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:18:33 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/console.log" append="off"/>
Nov 14 16:18:33 user nova-compute[75097]:     </serial>
Nov 14 16:18:33 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:18:33 user nova-compute[75097]:     <video>
Nov 14 16:18:33 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:18:33 user nova-compute[75097]:     </video>
Nov 14 16:18:33 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:18:33 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:18:33 user nova-compute[75097]:     </rng>
Nov 14 16:18:33 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:18:33 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:18:33 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:18:33 user nova-compute[75097]:     </memballoon>
Nov 14 16:18:33 user nova-compute[75097]:   </devices>
Nov 14 16:18:33 user nova-compute[75097]: </domain>
Nov 14 16:18:33 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026740153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026740153',id=31,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJkJneQF8jADu23T7xukX6Erw1pMtRbIZCg7OEWsueJmWMzA9BASjxEjDDdgfVmTW4dgloXHpY97nUgQr619DW50mqIGnxGd42NZ34QRB6CV4B9aBclkM4t/xIgYEdEA==',key_name='tempest-keypair-1809749550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-r2hzputd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=ba5d73ac-e962-4121-80c1-4d48077851ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG os_vif [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f66edbb-5aa7-512e-a8e8-6363c171f161', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabc26054-33, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabc26054-33, col_values=(('qos', UUID('1966a476-3ed5-43c4-b837-f64d39f9c994')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabc26054-33, col_values=(('external_ids', {'iface-id': 'abc26054-33f4-4cd1-8038-2d0737b45add', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:10:31', 'vm-uuid': 'ba5d73ac-e962-4121-80c1-4d48077851ab'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:33 user nova-compute[75097]: INFO os_vif [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33')
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No VIF found with MAC fa:16:3e:39:10:31, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updated VIF entry in instance network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:18:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9c4af6c0-1b21-40ce-86ae-9aea684f6493 req-c32a50bc-604e-461a-b8ad-76dc5bf52367 service nova] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9ee74da6-f7bd-4d67-8e30-50c9e88f727c req-9222dc0c-b3e4-467f-be11-d61b39f68af3 service nova] [instance: 77e94c18-d8e8-48b0-a421-0dae51fe4778] Received event network-vif-deleted-3998dd10-a0a1-4b78-a5b4-8b505491676e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-713f73ed-43ea-4971-8221-03ff364ddfba req-d72e22a8-c23d-4c0a-8821-549bde5f0d51 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-713f73ed-43ea-4971-8221-03ff364ddfba req-d72e22a8-c23d-4c0a-8821-549bde5f0d51 service nova] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-713f73ed-43ea-4971-8221-03ff364ddfba req-d72e22a8-c23d-4c0a-8821-549bde5f0d51 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-713f73ed-43ea-4971-8221-03ff364ddfba req-d72e22a8-c23d-4c0a-8821-549bde5f0d51 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-713f73ed-43ea-4971-8221-03ff364ddfba req-d72e22a8-c23d-4c0a-8821-549bde5f0d51 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] No waiting events found dispatching network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:35 user nova-compute[75097]: WARNING nova.compute.manager [req-713f73ed-43ea-4971-8221-03ff364ddfba req-d72e22a8-c23d-4c0a-8821-549bde5f0d51 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received unexpected event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add for instance with vm_state building and task_state spawning.
Nov 14 16:18:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:18:37 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance spawned successfully.
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:18:37 user nova-compute[75097]: INFO nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc34b66b-7c30-4f47-8fb5-e3b568225ba9 req-b416dc38-afed-402f-9b34-607c51498d56 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc34b66b-7c30-4f47-8fb5-e3b568225ba9 req-b416dc38-afed-402f-9b34-607c51498d56 service nova] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc34b66b-7c30-4f47-8fb5-e3b568225ba9 req-b416dc38-afed-402f-9b34-607c51498d56 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bc34b66b-7c30-4f47-8fb5-e3b568225ba9 req-b416dc38-afed-402f-9b34-607c51498d56 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-bc34b66b-7c30-4f47-8fb5-e3b568225ba9 req-b416dc38-afed-402f-9b34-607c51498d56 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] No waiting events found dispatching network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:37 user nova-compute[75097]: WARNING nova.compute.manager [req-bc34b66b-7c30-4f47-8fb5-e3b568225ba9 req-b416dc38-afed-402f-9b34-607c51498d56 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received unexpected event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add for instance with vm_state building and task_state spawning.
Nov 14 16:18:37 user nova-compute[75097]: INFO nova.compute.manager [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Took 6.35 seconds to build instance.
Nov 14 16:18:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6259dd25-9b82-4d39-bd80-f12fc2bc8f61 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.438s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:45 user nova-compute[75097]: INFO nova.compute.manager [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Terminating instance
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-def6d62b-1729-43dc-8a74-d6752c06267e req-745769b9-b319-4225-81f0-603c635dddd4 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-unplugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-def6d62b-1729-43dc-8a74-d6752c06267e req-745769b9-b319-4225-81f0-603c635dddd4 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-def6d62b-1729-43dc-8a74-d6752c06267e req-745769b9-b319-4225-81f0-603c635dddd4 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-def6d62b-1729-43dc-8a74-d6752c06267e req-745769b9-b319-4225-81f0-603c635dddd4 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-def6d62b-1729-43dc-8a74-d6752c06267e req-745769b9-b319-4225-81f0-603c635dddd4 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-unplugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.compute.manager [req-def6d62b-1729-43dc-8a74-d6752c06267e req-745769b9-b319-4225-81f0-603c635dddd4 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-unplugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Instance destroyed successfully.
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.objects.instance [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'resources' on Instance uuid ec6aa836-f4e8-4001-8273-6782614acfb8 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-398788755',display_name='tempest-ServerActionsTestOtherA-server-398788755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-398788755',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:14:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-e06avr4s',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=ec6aa836-f4e8-4001-8273-6782614acfb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "address": "fa:16:3e:22:17:30", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape88d4652-4c", "ovs_interfaceid": "e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_vif [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape88d4652-4c, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb5075c8-edaf-4186-9504-992fdcc12a61) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:45 user nova-compute[75097]: INFO os_vif [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:17:30,bridge_name='br-int',has_traffic_filtering=True,id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape88d4652-4c')
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJCDTZXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:18:45 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fb6979-246d-42b8-83c1-76cbdfac62fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:18:45 user nova-compute[75097]: No targets found.
Nov 14 16:18:45 user nova-compute[75097]: iSNS:
Nov 14 16:18:45 user nova-compute[75097]: No targets found.
Nov 14 16:18:45 user nova-compute[75097]: STATIC:
Nov 14 16:18:45 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:18:45 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:45 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:45 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78
Nov 14 16:18:45 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:18:45 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:18:45 user nova-compute[75097]: FIRMWARE:
Nov 14 16:18:45 user nova-compute[75097]: No targets found.
Nov 14 16:18:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:18:45 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:18:45 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c37e123-70f4-4e7d-a79d-f45c2596d4c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5526884-1829-4537-956a-54604cfc6e71]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:18:45 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:18:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:18:45 user nova-compute[75097]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 (non-flash)
Nov 14 16:18:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981c9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0459b-c770-489b-b65c-782126f60438]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[423244ab-4fde-462f-be28-579ce8abc1cb]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:18:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ca974-a7bc-4e19-9943-bf79bb817a68]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b9a02f-1ae6-4cbe-aedc-db845ec0e524]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2724967c-7e4911d95998558c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2724967c', '/dev/disk/by-id/scsi-23765343931316439') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8269f9d3-83f8-4be8-93dc-88c4181a4cdd]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907fea7-196b-4ed4-9646-7516671f4169]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb987880-83fb-42be-8cb7-46df1a9da32a]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260]
Nov 14 16:18:46 user nova-compute[75097]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78, portal: 172.16.0.220,3260] successful.
Nov 14 16:18:46 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3f0015-d535-45a5-86e8-d69f3e6cbe78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e3335-2239-4f03-acf1-2fdd13d0170d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] <== disconnect_volume: return (368ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:18:46 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Deleting instance files /opt/stack/data/nova/instances/ec6aa836-f4e8-4001-8273-6782614acfb8_del
Nov 14 16:18:46 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Deletion of /opt/stack/data/nova/instances/ec6aa836-f4e8-4001-8273-6782614acfb8_del complete
Nov 14 16:18:46 user nova-compute[75097]: INFO nova.compute.manager [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:46 user nova-compute[75097]: INFO nova.compute.manager [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Terminating instance
Nov 14 16:18:46 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-3b0a1cb0-1f96-4ffa-a4b7-66b974438a25 req-4e6232d6-81c3-4b43-a528-2f4cf8911171 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-unplugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3b0a1cb0-1f96-4ffa-a4b7-66b974438a25 req-4e6232d6-81c3-4b43-a528-2f4cf8911171 service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3b0a1cb0-1f96-4ffa-a4b7-66b974438a25 req-4e6232d6-81c3-4b43-a528-2f4cf8911171 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3b0a1cb0-1f96-4ffa-a4b7-66b974438a25 req-4e6232d6-81c3-4b43-a528-2f4cf8911171 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-3b0a1cb0-1f96-4ffa-a4b7-66b974438a25 req-4e6232d6-81c3-4b43-a528-2f4cf8911171 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-unplugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-3b0a1cb0-1f96-4ffa-a4b7-66b974438a25 req-4e6232d6-81c3-4b43-a528-2f4cf8911171 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-unplugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-caf3d259-962b-4d87-ad76-247a19ecfdff req-a575043d-8d44-47c8-b49c-ef0b320c573d service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-deleted-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.compute.manager [req-caf3d259-962b-4d87-ad76-247a19ecfdff req-a575043d-8d44-47c8-b49c-ef0b320c573d service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Neutron deleted interface e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1; detaching it from the instance and deleting it from the info cache
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.network.neutron [req-caf3d259-962b-4d87-ad76-247a19ecfdff req-a575043d-8d44-47c8-b49c-ef0b320c573d service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Took 0.76 seconds to deallocate network for instance.
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-caf3d259-962b-4d87-ad76-247a19ecfdff req-a575043d-8d44-47c8-b49c-ef0b320c573d service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Detach interface failed, port_id=e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1, reason: Instance ec6aa836-f4e8-4001-8273-6782614acfb8 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-7263245a-3ce7-4e4e-b360-adb70d8ae567 req-8277421b-0ec5-4269-a154-299c99ea37d7 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7263245a-3ce7-4e4e-b360-adb70d8ae567 req-8277421b-0ec5-4269-a154-299c99ea37d7 service nova] Acquiring lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7263245a-3ce7-4e4e-b360-adb70d8ae567 req-8277421b-0ec5-4269-a154-299c99ea37d7 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7263245a-3ce7-4e4e-b360-adb70d8ae567 req-8277421b-0ec5-4269-a154-299c99ea37d7 service nova] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-7263245a-3ce7-4e4e-b360-adb70d8ae567 req-8277421b-0ec5-4269-a154-299c99ea37d7 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] No waiting events found dispatching network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:47 user nova-compute[75097]: WARNING nova.compute.manager [req-7263245a-3ce7-4e4e-b360-adb70d8ae567 req-8277421b-0ec5-4269-a154-299c99ea37d7 service nova] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Received unexpected event network-vif-plugged-e88d4652-4c7d-4eb2-b7aa-38f1adf7f0d1 for instance with vm_state active and task_state deleting.
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Instance destroyed successfully.
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lazy-loading 'resources' on Instance uuid 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1980538968',display_name='tempest-TestMinimumBasicScenario-server-1980538968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1980538968',id=29,image_ref='5e16bc28-168a-4993-9406-4f9fc1222fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyN1ijuNsWmrRCzYvBfPSAiCTTGxfl+g8iLl/LmhxAgBL9zeWR5hroZglVkdcQnNumaio3hpu7tIflOU207dQqwhbtjQyOSVi4TSVUVLC6lidZmgpKc3DYxUk4I/yI36A==',key_name='tempest-TestMinimumBasicScenario-1849422009',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91e9e2ab228546a3b3d0b34f27bb5677',ramdisk_id='',reservation_id='r-1hy2mztn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e16bc28-168a-4993-9406-4f9fc1222fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-359238341',owner_user_name='tempest-TestMinimumBasicScenario-359238341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:16:09Z,user_data=None,user_id='664b6227948844139c66874de91fab7d',uuid=4fd98396-940a-4ee5-9ec8-4f64c8c73a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converting VIF {"id": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "address": "fa:16:3e:3d:62:22", "network": {"id": "cbf92034-c49d-4592-b2ca-e017e6b47213", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1976881393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91e9e2ab228546a3b3d0b34f27bb5677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap626a93f6-65", "ovs_interfaceid": "626a93f6-6527-40e1-9042-8dfb9d5dff92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG os_vif [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap626a93f6-65, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83c2519d-4068-4c49-924c-ae108ec7a310) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:47 user nova-compute[75097]: INFO os_vif [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:62:22,bridge_name='br-int',has_traffic_filtering=True,id=626a93f6-6527-40e1-9042-8dfb9d5dff92,network=Network(cbf92034-c49d-4592-b2ca-e017e6b47213),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap626a93f6-65')
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Deleting instance files /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53_del
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Deletion of /opt/stack/data/nova/instances/4fd98396-940a-4ee5-9ec8-4f64c8c73a53_del complete
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:18:47 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid 'ec6aa836-f4e8-4001-8273-6782614acfb8' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ec6aa836-f4e8-4001-8273-6782614acfb8' (instance-0000001b)
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.compute.manager [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Took 0.88 seconds to detach 1 volumes for instance.
Nov 14 16:18:47 user nova-compute[75097]: INFO nova.compute.manager [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: ec6aa836-f4e8-4001-8273-6782614acfb8] Deleting volume: 7c3f0015-d535-45a5-86e8-d69f3e6cbe78 {{(pid=75097) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:18:47 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:18:47 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:18:47 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=25.15277862548828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ec6aa836-f4e8-4001-8273-6782614acfb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ba5d73ac-e962-4121-80c1-4d48077851ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.273s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:48 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Took 0.47 seconds to deallocate network for instance.
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.105s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:48 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Deleted allocations for instance ec6aa836-f4e8-4001-8273-6782614acfb8
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-61dfcadd-b776-4245-9d04-d5cc0933266b tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "ec6aa836-f4e8-4001-8273-6782614acfb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.687s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:48 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Deleted allocations for instance 4fd98396-940a-4ee5-9ec8-4f64c8c73a53
Nov 14 16:18:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aacf29e-fef8-4880-93cf-85239e0ccc2c tempest-TestMinimumBasicScenario-359238341 tempest-TestMinimumBasicScenario-359238341-project-member] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-6a8681d7-a0d8-49ef-b20f-96572118694d req-7f9c154e-cd64-45fe-a2d1-17b65519b238 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6a8681d7-a0d8-49ef-b20f-96572118694d req-7f9c154e-cd64-45fe-a2d1-17b65519b238 service nova] Acquiring lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:18:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6a8681d7-a0d8-49ef-b20f-96572118694d req-7f9c154e-cd64-45fe-a2d1-17b65519b238 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:18:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6a8681d7-a0d8-49ef-b20f-96572118694d req-7f9c154e-cd64-45fe-a2d1-17b65519b238 service nova] Lock "4fd98396-940a-4ee5-9ec8-4f64c8c73a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:18:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-6a8681d7-a0d8-49ef-b20f-96572118694d req-7f9c154e-cd64-45fe-a2d1-17b65519b238 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] No waiting events found dispatching network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:18:49 user nova-compute[75097]: WARNING nova.compute.manager [req-6a8681d7-a0d8-49ef-b20f-96572118694d req-7f9c154e-cd64-45fe-a2d1-17b65519b238 service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received unexpected event network-vif-plugged-626a93f6-6527-40e1-9042-8dfb9d5dff92 for instance with vm_state deleted and task_state None.
Nov 14 16:18:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-e8476f94-9ebf-4e51-b576-530fe818b35f req-2ecd0ea4-af34-439b-8a37-195857b2f89b service nova] [instance: 4fd98396-940a-4ee5-9ec8-4f64c8c73a53] Received event network-vif-deleted-626a93f6-6527-40e1-9042-8dfb9d5dff92 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:18:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:18:53 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:18:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:18:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:19:03 user nova-compute[75097]: INFO nova.compute.claims [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Claim successful on node user
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:19:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.policy [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bb999bbbcf4d4c9058ea6921655732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aefeb20cd07a41f09d0c4e19e99518f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:19:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Creating image(s)
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.165s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.164s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk 1073741824" returned: 0 in 0.053s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Successfully created port: 026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Cannot resize image /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Ensure instance console log exists: /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Successfully updated port: 026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-changed-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Refreshing instance network info cache due to event network-changed-026968fd-2db9-4659-8e81-faa34162666f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:19:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] Acquiring lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updating instance_info_cache with network_info: [{"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Instance network_info: |[{"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] Acquired lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Refreshing network info cache for port 026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Start _get_guest_xml network_info=[{"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:19:05 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:19:05 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1420381695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1420381695',id=32,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-i3ke97y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:19:04Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=5a10a8dd-6ca4-4ada-aa74-e21278478d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.objects.instance [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a10a8dd-6ca4-4ada-aa74-e21278478d4f {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:19:05 user nova-compute[75097]:   <uuid>5a10a8dd-6ca4-4ada-aa74-e21278478d4f</uuid>
Nov 14 16:19:05 user nova-compute[75097]:   <name>instance-00000020</name>
Nov 14 16:19:05 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:19:05 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:19:05 user nova-compute[75097]:   <metadata>
Nov 14 16:19:05 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:19:05 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:19:05 user nova-compute[75097]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1420381695</nova:name>
Nov 14 16:19:05 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:19:05</nova:creationTime>
Nov 14 16:19:05 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:19:05 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:19:05 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:19:05 user nova-compute[75097]:       <nova:owner>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:user uuid="b4bb999bbbcf4d4c9058ea6921655732">tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member</nova:user>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:project uuid="aefeb20cd07a41f09d0c4e19e99518f0">tempest-ServerBootFromVolumeStableRescueTest-1745607452</nova:project>
Nov 14 16:19:05 user nova-compute[75097]:       </nova:owner>
Nov 14 16:19:05 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:19:05 user nova-compute[75097]:       <nova:ports>
Nov 14 16:19:05 user nova-compute[75097]:         <nova:port uuid="026968fd-2db9-4659-8e81-faa34162666f">
Nov 14 16:19:05 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 16:19:05 user nova-compute[75097]:         </nova:port>
Nov 14 16:19:05 user nova-compute[75097]:       </nova:ports>
Nov 14 16:19:05 user nova-compute[75097]:     </nova:instance>
Nov 14 16:19:05 user nova-compute[75097]:   </metadata>
Nov 14 16:19:05 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:19:05 user nova-compute[75097]:     <system>
Nov 14 16:19:05 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:19:05 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:19:05 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:19:05 user nova-compute[75097]:       <entry name="serial">5a10a8dd-6ca4-4ada-aa74-e21278478d4f</entry>
Nov 14 16:19:05 user nova-compute[75097]:       <entry name="uuid">5a10a8dd-6ca4-4ada-aa74-e21278478d4f</entry>
Nov 14 16:19:05 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:19:05 user nova-compute[75097]:     </system>
Nov 14 16:19:05 user nova-compute[75097]:   </sysinfo>
Nov 14 16:19:05 user nova-compute[75097]:   <os>
Nov 14 16:19:05 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:19:05 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:19:05 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:19:05 user nova-compute[75097]:   </os>
Nov 14 16:19:05 user nova-compute[75097]:   <features>
Nov 14 16:19:05 user nova-compute[75097]:     <acpi/>
Nov 14 16:19:05 user nova-compute[75097]:     <apic/>
Nov 14 16:19:05 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:19:05 user nova-compute[75097]:   </features>
Nov 14 16:19:05 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:19:05 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:19:05 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:19:05 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:19:05 user nova-compute[75097]:   </clock>
Nov 14 16:19:05 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:19:05 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:19:05 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:19:05 user nova-compute[75097]:   </cpu>
Nov 14 16:19:05 user nova-compute[75097]:   <devices>
Nov 14 16:19:05 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:19:05 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:19:05 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk"/>
Nov 14 16:19:05 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:19:05 user nova-compute[75097]:     </disk>
Nov 14 16:19:05 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:19:05 user nova-compute[75097]:       <mac address="fa:16:3e:86:12:3e"/>
Nov 14 16:19:05 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:19:05 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:19:05 user nova-compute[75097]:       <target dev="tap026968fd-2d"/>
Nov 14 16:19:05 user nova-compute[75097]:     </interface>
Nov 14 16:19:05 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:19:05 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/console.log" append="off"/>
Nov 14 16:19:05 user nova-compute[75097]:     </serial>
Nov 14 16:19:05 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:19:05 user nova-compute[75097]:     <video>
Nov 14 16:19:05 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:19:05 user nova-compute[75097]:     </video>
Nov 14 16:19:05 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:19:05 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:19:05 user nova-compute[75097]:     </rng>
Nov 14 16:19:05 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:19:05 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:19:05 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:19:05 user nova-compute[75097]:     </memballoon>
Nov 14 16:19:05 user nova-compute[75097]:   </devices>
Nov 14 16:19:05 user nova-compute[75097]: </domain>
Nov 14 16:19:05 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1420381695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1420381695',id=32,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-i3ke97y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:19:04Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=5a10a8dd-6ca4-4ada-aa74-e21278478d4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG os_vif [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75b926d6-9d76-5d8d-bc83-62763b7d4d76', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap026968fd-2d, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap026968fd-2d, col_values=(('qos', UUID('901d95b1-4246-4fb4-b6b0-bffdbea21abb')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap026968fd-2d, col_values=(('external_ids', {'iface-id': '026968fd-2db9-4659-8e81-faa34162666f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:12:3e', 'vm-uuid': '5a10a8dd-6ca4-4ada-aa74-e21278478d4f'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:05 user nova-compute[75097]: INFO os_vif [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d')
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No VIF found with MAC fa:16:3e:86:12:3e, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updated VIF entry in instance network info cache for port 026968fd-2db9-4659-8e81-faa34162666f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updating instance_info_cache with network_info: [{"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:19:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f277f182-86bd-4cba-ab7b-32f120ebdd6d req-4e9e120f-4ad9-449c-b710-b64372e719e9 service nova] Releasing lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] No waiting events found dispatching network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:19:07 user nova-compute[75097]: WARNING nova.compute.manager [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received unexpected event network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f for instance with vm_state building and task_state spawning.
Nov 14 16:19:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] No waiting events found dispatching network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:19:07 user nova-compute[75097]: WARNING nova.compute.manager [req-149bda59-6aad-473c-8ded-b544295cf031 req-9ae8f189-524a-4d0c-a453-3ed9ea427202 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received unexpected event network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f for instance with vm_state building and task_state spawning.
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:19:08 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Instance spawned successfully.
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:19:08 user nova-compute[75097]: INFO nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 14 16:19:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:19:08 user nova-compute[75097]: INFO nova.compute.manager [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Took 5.47 seconds to build instance.
Nov 14 16:19:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7de096da-7770-4914-be34-c5d6e0141eb6 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.564s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:19:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:37 user nova-compute[75097]: INFO nova.compute.manager [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Terminating instance
Nov 14 16:19:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c15dcf8-088b-4ac8-8d03-e653c2fb52c3 req-35769641-9a7e-44fb-b7f6-ff3756e37874 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-vif-unplugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c15dcf8-088b-4ac8-8d03-e653c2fb52c3 req-35769641-9a7e-44fb-b7f6-ff3756e37874 service nova] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c15dcf8-088b-4ac8-8d03-e653c2fb52c3 req-35769641-9a7e-44fb-b7f6-ff3756e37874 service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6c15dcf8-088b-4ac8-8d03-e653c2fb52c3 req-35769641-9a7e-44fb-b7f6-ff3756e37874 service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c15dcf8-088b-4ac8-8d03-e653c2fb52c3 req-35769641-9a7e-44fb-b7f6-ff3756e37874 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] No waiting events found dispatching network-vif-unplugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-6c15dcf8-088b-4ac8-8d03-e653c2fb52c3 req-35769641-9a7e-44fb-b7f6-ff3756e37874 service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-vif-unplugged-ea4601d8-356b-454b-945c-c469766efbab for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:19:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Instance destroyed successfully.
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lazy-loading 'resources' on Instance uuid c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1907693086',display_name='tempest-ServerActionsTestOtherA-server-1907693086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1907693086',id=6,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGwlGLN4RenLfqNjfA04GaiKlEMCHj1iNFEn/DcxhelmfrhIeZYvx+z7/uzlPnhXUR107dvStRgoMU8ZJKRt99KPmyxdL7BXZ4wrtp1DsE4355zI7j0uU7nIoxSZjaIw==',key_name='tempest-keypair-1578015212',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='144c5ef426074ddca799c0f312162932',ramdisk_id='',reservation_id='r-31y5w6cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-715795194',owner_user_name='tempest-ServerActionsTestOtherA-715795194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e4dbd7176043dc87e7a41a87e60098',uuid=c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converting VIF {"id": "ea4601d8-356b-454b-945c-c469766efbab", "address": "fa:16:3e:76:3a:fb", "network": {"id": "d25eab3d-6934-42c9-87cd-4998bdaa5197", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1185718809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "144c5ef426074ddca799c0f312162932", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4601d8-35", "ovs_interfaceid": "ea4601d8-356b-454b-945c-c469766efbab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG os_vif [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea4601d8-35, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a304398b-bbb3-4eea-aabc-3b2199685568) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:38 user nova-compute[75097]: INFO os_vif [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:3a:fb,bridge_name='br-int',has_traffic_filtering=True,id=ea4601d8-356b-454b-945c-c469766efbab,network=Network(d25eab3d-6934-42c9-87cd-4998bdaa5197),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4601d8-35')
Nov 14 16:19:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Deleting instance files /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3_del
Nov 14 16:19:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Deletion of /opt/stack/data/nova/instances/c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3_del complete
Nov 14 16:19:38 user nova-compute[75097]: INFO nova.compute.manager [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 16:19:38 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:19:38 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:19:39 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:19:39 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Took 0.68 seconds to deallocate network for instance.
Nov 14 16:19:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-0e21b6c8-2b7d-4e24-8368-a35df15a719d req-71288d43-a31f-4f86-a81f-abb23d47c8ca service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-vif-deleted-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:19:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:19:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:19:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:39 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Deleted allocations for instance c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3
Nov 14 16:19:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c161b9b1-c9c8-4fdb-a17b-af89f5348877 tempest-ServerActionsTestOtherA-715795194 tempest-ServerActionsTestOtherA-715795194-project-member] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-6a4a3ed8-5d98-4aef-98a7-dc3e87b972b5 req-4117bbef-3788-42a8-97d7-748b5b12889f service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received event network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:19:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6a4a3ed8-5d98-4aef-98a7-dc3e87b972b5 req-4117bbef-3788-42a8-97d7-748b5b12889f service nova] Acquiring lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6a4a3ed8-5d98-4aef-98a7-dc3e87b972b5 req-4117bbef-3788-42a8-97d7-748b5b12889f service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6a4a3ed8-5d98-4aef-98a7-dc3e87b972b5 req-4117bbef-3788-42a8-97d7-748b5b12889f service nova] Lock "c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:40 user nova-compute[75097]: DEBUG nova.compute.manager [req-6a4a3ed8-5d98-4aef-98a7-dc3e87b972b5 req-4117bbef-3788-42a8-97d7-748b5b12889f service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] No waiting events found dispatching network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:19:40 user nova-compute[75097]: WARNING nova.compute.manager [req-6a4a3ed8-5d98-4aef-98a7-dc3e87b972b5 req-4117bbef-3788-42a8-97d7-748b5b12889f service nova] [instance: c3dcd91b-5367-42de-b24f-2ec1b1ffc3f3] Received unexpected event network-vif-plugged-ea4601d8-356b-454b-945c-c469766efbab for instance with vm_state deleted and task_state None.
Nov 14 16:19:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:19:47 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:19:47 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:19:47 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.18930435180664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:19:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ba5d73ac-e962-4121-80c1-4d48077851ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:19:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:19:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:53 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:19:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:19:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:20:00 user nova-compute[75097]: INFO nova.compute.claims [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Claim successful on node user
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:20:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:20:00 user nova-compute[75097]: DEBUG nova.policy [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6cf5cedfb85437c896b8345d0a4dc18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79cc6026624f4cc09811ef897515bf36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:20:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Creating image(s)
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "/opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "/opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "/opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk 1073741824" returned: 0 in 0.045s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Successfully created port: 38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Cannot resize image /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Ensure instance console log exists: /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Successfully updated port: 38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquired lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-changed-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Refreshing instance network info cache due to event network-changed-38a41d8f-7617-44be-9f7c-36169fc561ff. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:20:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] Acquiring lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.neutron [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating instance_info_cache with network_info: [{"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Releasing lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Instance network_info: |[{"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] Acquired lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.neutron [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Refreshing network info cache for port 38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Start _get_guest_xml network_info=[{"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:20:03 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:20:03 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1846401003',display_name='tempest-TestServerVolumeAttachmentScenario-server-1846401003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1846401003',id=33,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNewxPGylDRHyoiw1xiChnZQYvVsKA6dp7ljwzsZPtvGbwt1o3QFVxpYsNixGOArLEJMHZKZyf2y21Id/ECpz88piwM710ag54sDeSDk+SOzUAfWEkJ9qLxrZMr9nxyP2Q==',key_name='tempest-keypair-514708361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cc6026624f4cc09811ef897515bf36',ramdisk_id='',reservation_id='r-0efc2i20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1559548981',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1559548981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cf5cedfb85437c896b8345d0a4dc18',uuid=825e2a70-e053-4a26-8c53-7b4d55ab3d3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Converting VIF {"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'pci_devices' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:20:03 user nova-compute[75097]:   <uuid>825e2a70-e053-4a26-8c53-7b4d55ab3d3a</uuid>
Nov 14 16:20:03 user nova-compute[75097]:   <name>instance-00000021</name>
Nov 14 16:20:03 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:20:03 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:20:03 user nova-compute[75097]:   <metadata>
Nov 14 16:20:03 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:20:03 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:20:03 user nova-compute[75097]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1846401003</nova:name>
Nov 14 16:20:03 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:20:03</nova:creationTime>
Nov 14 16:20:03 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:20:03 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:20:03 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:20:03 user nova-compute[75097]:       <nova:owner>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:user uuid="a6cf5cedfb85437c896b8345d0a4dc18">tempest-TestServerVolumeAttachmentScenario-1559548981-project-member</nova:user>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:project uuid="79cc6026624f4cc09811ef897515bf36">tempest-TestServerVolumeAttachmentScenario-1559548981</nova:project>
Nov 14 16:20:03 user nova-compute[75097]:       </nova:owner>
Nov 14 16:20:03 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:20:03 user nova-compute[75097]:       <nova:ports>
Nov 14 16:20:03 user nova-compute[75097]:         <nova:port uuid="38a41d8f-7617-44be-9f7c-36169fc561ff">
Nov 14 16:20:03 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:20:03 user nova-compute[75097]:         </nova:port>
Nov 14 16:20:03 user nova-compute[75097]:       </nova:ports>
Nov 14 16:20:03 user nova-compute[75097]:     </nova:instance>
Nov 14 16:20:03 user nova-compute[75097]:   </metadata>
Nov 14 16:20:03 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:20:03 user nova-compute[75097]:     <system>
Nov 14 16:20:03 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:20:03 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:20:03 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:20:03 user nova-compute[75097]:       <entry name="serial">825e2a70-e053-4a26-8c53-7b4d55ab3d3a</entry>
Nov 14 16:20:03 user nova-compute[75097]:       <entry name="uuid">825e2a70-e053-4a26-8c53-7b4d55ab3d3a</entry>
Nov 14 16:20:03 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:20:03 user nova-compute[75097]:     </system>
Nov 14 16:20:03 user nova-compute[75097]:   </sysinfo>
Nov 14 16:20:03 user nova-compute[75097]:   <os>
Nov 14 16:20:03 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:20:03 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:20:03 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:20:03 user nova-compute[75097]:   </os>
Nov 14 16:20:03 user nova-compute[75097]:   <features>
Nov 14 16:20:03 user nova-compute[75097]:     <acpi/>
Nov 14 16:20:03 user nova-compute[75097]:     <apic/>
Nov 14 16:20:03 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:20:03 user nova-compute[75097]:   </features>
Nov 14 16:20:03 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:20:03 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:20:03 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:20:03 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:20:03 user nova-compute[75097]:   </clock>
Nov 14 16:20:03 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:20:03 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:20:03 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:20:03 user nova-compute[75097]:   </cpu>
Nov 14 16:20:03 user nova-compute[75097]:   <devices>
Nov 14 16:20:03 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:20:03 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:20:03 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk"/>
Nov 14 16:20:03 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:20:03 user nova-compute[75097]:     </disk>
Nov 14 16:20:03 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:20:03 user nova-compute[75097]:       <mac address="fa:16:3e:48:f6:f7"/>
Nov 14 16:20:03 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:20:03 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:20:03 user nova-compute[75097]:       <target dev="tap38a41d8f-76"/>
Nov 14 16:20:03 user nova-compute[75097]:     </interface>
Nov 14 16:20:03 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:20:03 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/console.log" append="off"/>
Nov 14 16:20:03 user nova-compute[75097]:     </serial>
Nov 14 16:20:03 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:20:03 user nova-compute[75097]:     <video>
Nov 14 16:20:03 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:20:03 user nova-compute[75097]:     </video>
Nov 14 16:20:03 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:20:03 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:20:03 user nova-compute[75097]:     </rng>
Nov 14 16:20:03 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:20:03 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:20:03 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:20:03 user nova-compute[75097]:     </memballoon>
Nov 14 16:20:03 user nova-compute[75097]:   </devices>
Nov 14 16:20:03 user nova-compute[75097]: </domain>
Nov 14 16:20:03 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1846401003',display_name='tempest-TestServerVolumeAttachmentScenario-server-1846401003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1846401003',id=33,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNewxPGylDRHyoiw1xiChnZQYvVsKA6dp7ljwzsZPtvGbwt1o3QFVxpYsNixGOArLEJMHZKZyf2y21Id/ECpz88piwM710ag54sDeSDk+SOzUAfWEkJ9qLxrZMr9nxyP2Q==',key_name='tempest-keypair-514708361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79cc6026624f4cc09811ef897515bf36',ramdisk_id='',reservation_id='r-0efc2i20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1559548981',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1559548981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cf5cedfb85437c896b8345d0a4dc18',uuid=825e2a70-e053-4a26-8c53-7b4d55ab3d3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Converting VIF {"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG os_vif [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e35cc582-023f-58e1-9838-6e6eaf89a4c5', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a41d8f-76, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a41d8f-76, col_values=(('qos', UUID('3931e6a1-5349-4a26-87e8-61a5955f848c')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a41d8f-76, col_values=(('external_ids', {'iface-id': '38a41d8f-7617-44be-9f7c-36169fc561ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:f6:f7', 'vm-uuid': '825e2a70-e053-4a26-8c53-7b4d55ab3d3a'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: INFO os_vif [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76')
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No VIF found with MAC fa:16:3e:48:f6:f7, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.neutron [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updated VIF entry in instance network info cache for port 38a41d8f-7617-44be-9f7c-36169fc561ff. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG nova.network.neutron [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating instance_info_cache with network_info: [{"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-753022d3-8366-4fef-8eb5-2638d02c6b28 req-720c00f1-2100-4016-b77f-b555b289fb99 service nova] Releasing lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:20:06 user nova-compute[75097]: INFO nova.compute.claims [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Claim successful on node user
Nov 14 16:20:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:20:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Instance spawned successfully.
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.policy [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2759dad7d2ed4ab998b1bb2a50269d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1049d85cb459183193d23a3cb60d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:20:06 user nova-compute[75097]: INFO nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:20:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Creating image(s)
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "/opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "/opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "/opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:07 user nova-compute[75097]: INFO nova.compute.manager [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Took 6.55 seconds to build instance.
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7db6416d-0a41-438b-8cc9-419644825da8 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.661s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Successfully created port: ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk 1073741824" returned: 0 in 0.049s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Cannot resize image /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Ensure instance console log exists: /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Successfully updated port: ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "refresh_cache-d608e55e-d0f0-47f8-8570-8741aed8aa2c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquired lock "refresh_cache-d608e55e-d0f0-47f8-8570-8741aed8aa2c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-changed-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Refreshing instance network info cache due to event network-changed-ebf0b419-63dc-4f48-998f-08a87efc994a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] Acquiring lock "refresh_cache-d608e55e-d0f0-47f8-8570-8741aed8aa2c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Updating instance_info_cache with network_info: [{"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Releasing lock "refresh_cache-d608e55e-d0f0-47f8-8570-8741aed8aa2c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Instance network_info: |[{"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] Acquired lock "refresh_cache-d608e55e-d0f0-47f8-8570-8741aed8aa2c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Refreshing network info cache for port ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Start _get_guest_xml network_info=[{"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:20:08 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:20:08 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-406924323',display_name='tempest-VolumesActionsTest-instance-406924323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-406924323',id=34,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1049d85cb459183193d23a3cb60d3',ramdisk_id='',reservation_id='r-uhf94un5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1541833219',owner_user_name='tempest-VolumesActionsTest-1541833219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:20:07Z,user_data=None,user_id='2759dad7d2ed4ab998b1bb2a50269d6c',uuid=d608e55e-d0f0-47f8-8570-8741aed8aa2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converting VIF {"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lazy-loading 'pci_devices' on Instance uuid d608e55e-d0f0-47f8-8570-8741aed8aa2c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:20:08 user nova-compute[75097]:   <uuid>d608e55e-d0f0-47f8-8570-8741aed8aa2c</uuid>
Nov 14 16:20:08 user nova-compute[75097]:   <name>instance-00000022</name>
Nov 14 16:20:08 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:20:08 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:20:08 user nova-compute[75097]:   <metadata>
Nov 14 16:20:08 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:20:08 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:20:08 user nova-compute[75097]:       <nova:name>tempest-VolumesActionsTest-instance-406924323</nova:name>
Nov 14 16:20:08 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:20:08</nova:creationTime>
Nov 14 16:20:08 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:20:08 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:20:08 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:20:08 user nova-compute[75097]:       <nova:owner>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:user uuid="2759dad7d2ed4ab998b1bb2a50269d6c">tempest-VolumesActionsTest-1541833219-project-member</nova:user>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:project uuid="4ae1049d85cb459183193d23a3cb60d3">tempest-VolumesActionsTest-1541833219</nova:project>
Nov 14 16:20:08 user nova-compute[75097]:       </nova:owner>
Nov 14 16:20:08 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:20:08 user nova-compute[75097]:       <nova:ports>
Nov 14 16:20:08 user nova-compute[75097]:         <nova:port uuid="ebf0b419-63dc-4f48-998f-08a87efc994a">
Nov 14 16:20:08 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 16:20:08 user nova-compute[75097]:         </nova:port>
Nov 14 16:20:08 user nova-compute[75097]:       </nova:ports>
Nov 14 16:20:08 user nova-compute[75097]:     </nova:instance>
Nov 14 16:20:08 user nova-compute[75097]:   </metadata>
Nov 14 16:20:08 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:20:08 user nova-compute[75097]:     <system>
Nov 14 16:20:08 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:20:08 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:20:08 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:20:08 user nova-compute[75097]:       <entry name="serial">d608e55e-d0f0-47f8-8570-8741aed8aa2c</entry>
Nov 14 16:20:08 user nova-compute[75097]:       <entry name="uuid">d608e55e-d0f0-47f8-8570-8741aed8aa2c</entry>
Nov 14 16:20:08 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:20:08 user nova-compute[75097]:     </system>
Nov 14 16:20:08 user nova-compute[75097]:   </sysinfo>
Nov 14 16:20:08 user nova-compute[75097]:   <os>
Nov 14 16:20:08 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:20:08 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:20:08 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:20:08 user nova-compute[75097]:   </os>
Nov 14 16:20:08 user nova-compute[75097]:   <features>
Nov 14 16:20:08 user nova-compute[75097]:     <acpi/>
Nov 14 16:20:08 user nova-compute[75097]:     <apic/>
Nov 14 16:20:08 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:20:08 user nova-compute[75097]:   </features>
Nov 14 16:20:08 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:20:08 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:20:08 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:20:08 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:20:08 user nova-compute[75097]:   </clock>
Nov 14 16:20:08 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:20:08 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:20:08 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:20:08 user nova-compute[75097]:   </cpu>
Nov 14 16:20:08 user nova-compute[75097]:   <devices>
Nov 14 16:20:08 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:20:08 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:20:08 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk"/>
Nov 14 16:20:08 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:20:08 user nova-compute[75097]:     </disk>
Nov 14 16:20:08 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:20:08 user nova-compute[75097]:       <mac address="fa:16:3e:18:6b:d3"/>
Nov 14 16:20:08 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:20:08 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:20:08 user nova-compute[75097]:       <target dev="tapebf0b419-63"/>
Nov 14 16:20:08 user nova-compute[75097]:     </interface>
Nov 14 16:20:08 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:20:08 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/console.log" append="off"/>
Nov 14 16:20:08 user nova-compute[75097]:     </serial>
Nov 14 16:20:08 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:20:08 user nova-compute[75097]:     <video>
Nov 14 16:20:08 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:20:08 user nova-compute[75097]:     </video>
Nov 14 16:20:08 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:20:08 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:20:08 user nova-compute[75097]:     </rng>
Nov 14 16:20:08 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:20:08 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:20:08 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:20:08 user nova-compute[75097]:     </memballoon>
Nov 14 16:20:08 user nova-compute[75097]:   </devices>
Nov 14 16:20:08 user nova-compute[75097]: </domain>
Nov 14 16:20:08 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-406924323',display_name='tempest-VolumesActionsTest-instance-406924323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-406924323',id=34,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1049d85cb459183193d23a3cb60d3',ramdisk_id='',reservation_id='r-uhf94un5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1541833219',owner_user_name='tempest-VolumesActionsTest-1541833219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:20:07Z,user_data=None,user_id='2759dad7d2ed4ab998b1bb2a50269d6c',uuid=d608e55e-d0f0-47f8-8570-8741aed8aa2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converting VIF {"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG os_vif [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7f4ec09-1077-511d-9ffc-1dc413eceb0b', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf0b419-63, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebf0b419-63, col_values=(('qos', UUID('68bb4e60-c341-41b8-a6cd-93d07468e235')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebf0b419-63, col_values=(('external_ids', {'iface-id': 'ebf0b419-63dc-4f48-998f-08a87efc994a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:6b:d3', 'vm-uuid': 'd608e55e-d0f0-47f8-8570-8741aed8aa2c'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:08 user nova-compute[75097]: INFO os_vif [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63')
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] No VIF found with MAC fa:16:3e:18:6b:d3, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Updated VIF entry in instance network info cache for port ebf0b419-63dc-4f48-998f-08a87efc994a. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Updating instance_info_cache with network_info: [{"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b887c5eb-9bf0-4cc0-86fb-aec88d9ba682 req-c050707d-b270-46f8-a688-4a0bd3cdb123 service nova] Releasing lock "refresh_cache-d608e55e-d0f0-47f8-8570-8741aed8aa2c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-c5bf511d-00c4-4050-9118-26ee7aff46c5 req-cdd78dee-1a17-49b6-83b7-784d31bd0e6a service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c5bf511d-00c4-4050-9118-26ee7aff46c5 req-cdd78dee-1a17-49b6-83b7-784d31bd0e6a service nova] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c5bf511d-00c4-4050-9118-26ee7aff46c5 req-cdd78dee-1a17-49b6-83b7-784d31bd0e6a service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c5bf511d-00c4-4050-9118-26ee7aff46c5 req-cdd78dee-1a17-49b6-83b7-784d31bd0e6a service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-c5bf511d-00c4-4050-9118-26ee7aff46c5 req-cdd78dee-1a17-49b6-83b7-784d31bd0e6a service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] No waiting events found dispatching network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:20:09 user nova-compute[75097]: WARNING nova.compute.manager [req-c5bf511d-00c4-4050-9118-26ee7aff46c5 req-cdd78dee-1a17-49b6-83b7-784d31bd0e6a service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received unexpected event network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff for instance with vm_state active and task_state None.
Nov 14 16:20:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-6776c7c2-c2f4-4700-8747-573ce44606a8 req-d54f0eba-13ac-4049-af6e-444be9dbc75d service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6776c7c2-c2f4-4700-8747-573ce44606a8 req-d54f0eba-13ac-4049-af6e-444be9dbc75d service nova] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6776c7c2-c2f4-4700-8747-573ce44606a8 req-d54f0eba-13ac-4049-af6e-444be9dbc75d service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6776c7c2-c2f4-4700-8747-573ce44606a8 req-d54f0eba-13ac-4049-af6e-444be9dbc75d service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-6776c7c2-c2f4-4700-8747-573ce44606a8 req-d54f0eba-13ac-4049-af6e-444be9dbc75d service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] No waiting events found dispatching network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:20:10 user nova-compute[75097]: WARNING nova.compute.manager [req-6776c7c2-c2f4-4700-8747-573ce44606a8 req-d54f0eba-13ac-4049-af6e-444be9dbc75d service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received unexpected event network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a for instance with vm_state building and task_state spawning.
Nov 14 16:20:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-ffa4a082-538d-4b1d-910f-35c7413f3d9e req-7672297c-ead2-438d-9f0d-7319fde6eec3 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ffa4a082-538d-4b1d-910f-35c7413f3d9e req-7672297c-ead2-438d-9f0d-7319fde6eec3 service nova] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ffa4a082-538d-4b1d-910f-35c7413f3d9e req-7672297c-ead2-438d-9f0d-7319fde6eec3 service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ffa4a082-538d-4b1d-910f-35c7413f3d9e req-7672297c-ead2-438d-9f0d-7319fde6eec3 service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-ffa4a082-538d-4b1d-910f-35c7413f3d9e req-7672297c-ead2-438d-9f0d-7319fde6eec3 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] No waiting events found dispatching network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:20:11 user nova-compute[75097]: WARNING nova.compute.manager [req-ffa4a082-538d-4b1d-910f-35c7413f3d9e req-7672297c-ead2-438d-9f0d-7319fde6eec3 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received unexpected event network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff for instance with vm_state active and task_state None.
Nov 14 16:20:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:20:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Instance spawned successfully.
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-69eb4372-edb7-47ae-9ae6-56d5363cc076 req-85a8ecbb-9527-4306-9a97-d0fb401303e9 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-69eb4372-edb7-47ae-9ae6-56d5363cc076 req-85a8ecbb-9527-4306-9a97-d0fb401303e9 service nova] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-69eb4372-edb7-47ae-9ae6-56d5363cc076 req-85a8ecbb-9527-4306-9a97-d0fb401303e9 service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-69eb4372-edb7-47ae-9ae6-56d5363cc076 req-85a8ecbb-9527-4306-9a97-d0fb401303e9 service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-69eb4372-edb7-47ae-9ae6-56d5363cc076 req-85a8ecbb-9527-4306-9a97-d0fb401303e9 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] No waiting events found dispatching network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:20:12 user nova-compute[75097]: WARNING nova.compute.manager [req-69eb4372-edb7-47ae-9ae6-56d5363cc076 req-85a8ecbb-9527-4306-9a97-d0fb401303e9 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received unexpected event network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a for instance with vm_state building and task_state spawning.
Nov 14 16:20:12 user nova-compute[75097]: INFO nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 14 16:20:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:20:12 user nova-compute[75097]: INFO nova.compute.manager [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Took 5.77 seconds to build instance.
Nov 14 16:20:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17b81979-63ef-48af-a7ea-4725bde6f743 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.859s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing instance network info cache due to event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updated VIF entry in instance network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f81ce3f6-cb5b-45e4-9822-cc2a722ca685 req-edd090bf-79ad-4132-baed-82245f93aae9 service nova] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:24 user nova-compute[75097]: INFO nova.compute.manager [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Shelving
Nov 14 16:20:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-48dff2e4-f1c6-4e0e-8cee-d2ba31fdc0c3 req-9fe8b5b9-709d-4739-a2f9-b7106adf0021 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-unplugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-48dff2e4-f1c6-4e0e-8cee-d2ba31fdc0c3 req-9fe8b5b9-709d-4739-a2f9-b7106adf0021 service nova] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-48dff2e4-f1c6-4e0e-8cee-d2ba31fdc0c3 req-9fe8b5b9-709d-4739-a2f9-b7106adf0021 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-48dff2e4-f1c6-4e0e-8cee-d2ba31fdc0c3 req-9fe8b5b9-709d-4739-a2f9-b7106adf0021 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-48dff2e4-f1c6-4e0e-8cee-d2ba31fdc0c3 req-9fe8b5b9-709d-4739-a2f9-b7106adf0021 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] No waiting events found dispatching network-vif-unplugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:20:24 user nova-compute[75097]: WARNING nova.compute.manager [req-48dff2e4-f1c6-4e0e-8cee-d2ba31fdc0c3 req-9fe8b5b9-709d-4739-a2f9-b7106adf0021 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received unexpected event network-vif-unplugged-abc26054-33f4-4cd1-8038-2d0737b45add for instance with vm_state active and task_state shelving.
Nov 14 16:20:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance destroyed successfully.
Nov 14 16:20:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Beginning cold snapshot process
Nov 14 16:20:25 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:20:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk /opt/stack/data/nova/instances/snapshots/tmp5g0_9l4b/9d0e8cdf617748c7bf816baf1e5ba112 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk /opt/stack/data/nova/instances/snapshots/tmp5g0_9l4b/9d0e8cdf617748c7bf816baf1e5ba112" returned: 0 in 0.584s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Snapshot extracted, beginning image upload
Nov 14 16:20:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-c3269df1-334a-4893-b3bc-170fbbc3340d req-39c9ba4d-ee78-451a-bded-866260aaac57 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c3269df1-334a-4893-b3bc-170fbbc3340d req-39c9ba4d-ee78-451a-bded-866260aaac57 service nova] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c3269df1-334a-4893-b3bc-170fbbc3340d req-39c9ba4d-ee78-451a-bded-866260aaac57 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c3269df1-334a-4893-b3bc-170fbbc3340d req-39c9ba4d-ee78-451a-bded-866260aaac57 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-c3269df1-334a-4893-b3bc-170fbbc3340d req-39c9ba4d-ee78-451a-bded-866260aaac57 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] No waiting events found dispatching network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:20:26 user nova-compute[75097]: WARNING nova.compute.manager [req-c3269df1-334a-4893-b3bc-170fbbc3340d req-39c9ba4d-ee78-451a-bded-866260aaac57 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received unexpected event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 16:20:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Snapshot image upload complete
Nov 14 16:20:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:20:28 user nova-compute[75097]: INFO nova.compute.manager [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Shelve offloading
Nov 14 16:20:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance destroyed successfully.
Nov 14 16:20:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:20:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:20:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance destroyed successfully.
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'resources' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026740153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026740153',id=31,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJkJneQF8jADu23T7xukX6Erw1pMtRbIZCg7OEWsueJmWMzA9BASjxEjDDdgfVmTW4dgloXHpY97nUgQr619DW50mqIGnxGd42NZ34QRB6CV4B9aBclkM4t/xIgYEdEA==',key_name='tempest-keypair-1809749550',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-r2hzputd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member',shelved_at='2023-11-14T16:20:28.859498',shelved_host='user',shelved_image_id='cb4a6acf-8d7c-4b91-bbfa-80668766a512'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=ba5d73ac-e962-4121-80c1-4d48077851ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG os_vif [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabc26054-33, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing instance network info cache due to event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.network.neutron [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1966a476-3ed5-43c4-b837-f64d39f9c994) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:30 user nova-compute[75097]: INFO os_vif [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33')
Nov 14 16:20:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Deleting instance files /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab_del
Nov 14 16:20:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Deletion of /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab_del complete
Nov 14 16:20:30 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Deleted allocations for instance ba5d73ac-e962-4121-80c1-4d48077851ab
Nov 14 16:20:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'numa_topology' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:20:30 user nova-compute[75097]: DEBUG nova.objects.base [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<ba5d73ac-e962-4121-80c1-4d48077851ab> lazy-loaded attributes: resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17f8a3a5-05d1-413d-a940-d5b89cafdbc2 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.754s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG nova.network.neutron [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updated VIF entry in instance network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG nova.network.neutron [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapabc26054-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-91a5d222-dbd5-4413-9522-b5c08ebcfab0 req-7774f9aa-da45-4c5a-b380-a94df6c172a2 service nova] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:20:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=25.098556518554688GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d608e55e-d0f0-47f8-8570-8741aed8aa2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:20:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:20:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:20:52 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:20:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:20:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:20:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:20:53 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:20:54 user nova-compute[75097]: INFO nova.compute.manager [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] instance snapshotting
Nov 14 16:20:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Beginning live snapshot process
Nov 14 16:20:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjxf7c_l3/ae48ffb574b547128f73a6021418ab3c.delta 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjxf7c_l3/ae48ffb574b547128f73a6021418ab3c.delta 1073741824" returned: 0 in 0.047s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:55 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 16:20:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:20:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:20:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:20:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 16:20:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:20:56 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:20:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjxf7c_l3/ae48ffb574b547128f73a6021418ab3c.delta /opt/stack/data/nova/instances/snapshots/tmpjxf7c_l3/ae48ffb574b547128f73a6021418ab3c {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:20:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjxf7c_l3/ae48ffb574b547128f73a6021418ab3c.delta /opt/stack/data/nova/instances/snapshots/tmpjxf7c_l3/ae48ffb574b547128f73a6021418ab3c" returned: 0 in 0.592s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:20:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Snapshot extracted, beginning image upload
Nov 14 16:20:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:20:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Snapshot image upload complete
Nov 14 16:21:00 user nova-compute[75097]: INFO nova.compute.manager [None req-750126f4-a0be-4d09-9499-ac68caa61c47 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Took 5.52 seconds to snapshot the instance on the hypervisor.
Nov 14 16:21:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:21:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:21:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:21:27 user nova-compute[75097]: INFO nova.compute.claims [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Claim successful on node user
Nov 14 16:21:27 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:21:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.policy [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53827b8c6b514b68987dd448fbc17bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13dd81460e04ef0a3ef496334da5241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:21:28 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Creating image(s)
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "/opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "/opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "/opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.164s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk 1073741824" returned: 0 in 0.057s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Successfully created port: 1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Cannot resize image /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Ensure instance console log exists: /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Successfully updated port: 1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-changed-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Refreshing instance network info cache due to event network-changed-1a9de883-33f2-4e14-8f36-702ceed50640. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] Acquiring lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] Acquired lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Refreshing network info cache for port 1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cac1388e-841d-4433-ad88-19cc4cd324c9 req-7d2f8f5f-ea30-45cd-bbe9-e0660be4108b service nova] Releasing lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquired lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [{"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Releasing lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Instance network_info: |[{"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Start _get_guest_xml network_info=[{"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:21:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:21:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1835236991',display_name='tempest-TestStampPattern-server-1835236991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1835236991',id=35,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbs2YwP80IOgHAD4NMnt5vdrmpl7fZEhV1O1GdfggXQ4hLf7fZp3jF2/qIPcowDLKmtwQQ+3ReVQ1RBSOK4/wv8tfl5WIvkE/weu2QpYUM+/xPDHk3JFkaKTleUxqTr3Q==',key_name='tempest-TestStampPattern-1197072316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dd81460e04ef0a3ef496334da5241',ramdisk_id='',reservation_id='r-yo4gu7q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1146793101',owner_user_name='tempest-TestStampPattern-1146793101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:21:28Z,user_data=None,user_id='53827b8c6b514b68987dd448fbc17bcd',uuid=a77934ca-8e15-4158-9d25-cd20427d5b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converting VIF {"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.objects.instance [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'pci_devices' on Instance uuid a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:21:29 user nova-compute[75097]:   <uuid>a77934ca-8e15-4158-9d25-cd20427d5b07</uuid>
Nov 14 16:21:29 user nova-compute[75097]:   <name>instance-00000023</name>
Nov 14 16:21:29 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:21:29 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:21:29 user nova-compute[75097]:   <metadata>
Nov 14 16:21:29 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:21:29 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:21:29 user nova-compute[75097]:       <nova:name>tempest-TestStampPattern-server-1835236991</nova:name>
Nov 14 16:21:29 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:21:29</nova:creationTime>
Nov 14 16:21:29 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:21:29 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:21:29 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:21:29 user nova-compute[75097]:       <nova:owner>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:user uuid="53827b8c6b514b68987dd448fbc17bcd">tempest-TestStampPattern-1146793101-project-member</nova:user>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:project uuid="e13dd81460e04ef0a3ef496334da5241">tempest-TestStampPattern-1146793101</nova:project>
Nov 14 16:21:29 user nova-compute[75097]:       </nova:owner>
Nov 14 16:21:29 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:21:29 user nova-compute[75097]:       <nova:ports>
Nov 14 16:21:29 user nova-compute[75097]:         <nova:port uuid="1a9de883-33f2-4e14-8f36-702ceed50640">
Nov 14 16:21:29 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:21:29 user nova-compute[75097]:         </nova:port>
Nov 14 16:21:29 user nova-compute[75097]:       </nova:ports>
Nov 14 16:21:29 user nova-compute[75097]:     </nova:instance>
Nov 14 16:21:29 user nova-compute[75097]:   </metadata>
Nov 14 16:21:29 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:21:29 user nova-compute[75097]:     <system>
Nov 14 16:21:29 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:21:29 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:21:29 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:21:29 user nova-compute[75097]:       <entry name="serial">a77934ca-8e15-4158-9d25-cd20427d5b07</entry>
Nov 14 16:21:29 user nova-compute[75097]:       <entry name="uuid">a77934ca-8e15-4158-9d25-cd20427d5b07</entry>
Nov 14 16:21:29 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:21:29 user nova-compute[75097]:     </system>
Nov 14 16:21:29 user nova-compute[75097]:   </sysinfo>
Nov 14 16:21:29 user nova-compute[75097]:   <os>
Nov 14 16:21:29 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:21:29 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:21:29 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:21:29 user nova-compute[75097]:   </os>
Nov 14 16:21:29 user nova-compute[75097]:   <features>
Nov 14 16:21:29 user nova-compute[75097]:     <acpi/>
Nov 14 16:21:29 user nova-compute[75097]:     <apic/>
Nov 14 16:21:29 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:21:29 user nova-compute[75097]:   </features>
Nov 14 16:21:29 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:21:29 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:21:29 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:21:29 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:21:29 user nova-compute[75097]:   </clock>
Nov 14 16:21:29 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:21:29 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:21:29 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:21:29 user nova-compute[75097]:   </cpu>
Nov 14 16:21:29 user nova-compute[75097]:   <devices>
Nov 14 16:21:29 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:21:29 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:21:29 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk"/>
Nov 14 16:21:29 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:21:29 user nova-compute[75097]:     </disk>
Nov 14 16:21:29 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:21:29 user nova-compute[75097]:       <mac address="fa:16:3e:33:fa:87"/>
Nov 14 16:21:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:21:29 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:21:29 user nova-compute[75097]:       <target dev="tap1a9de883-33"/>
Nov 14 16:21:29 user nova-compute[75097]:     </interface>
Nov 14 16:21:29 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:21:29 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/console.log" append="off"/>
Nov 14 16:21:29 user nova-compute[75097]:     </serial>
Nov 14 16:21:29 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:21:29 user nova-compute[75097]:     <video>
Nov 14 16:21:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:21:29 user nova-compute[75097]:     </video>
Nov 14 16:21:29 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:21:29 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:21:29 user nova-compute[75097]:     </rng>
Nov 14 16:21:29 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:21:29 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:21:29 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:21:29 user nova-compute[75097]:     </memballoon>
Nov 14 16:21:29 user nova-compute[75097]:   </devices>
Nov 14 16:21:29 user nova-compute[75097]: </domain>
Nov 14 16:21:29 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1835236991',display_name='tempest-TestStampPattern-server-1835236991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1835236991',id=35,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbs2YwP80IOgHAD4NMnt5vdrmpl7fZEhV1O1GdfggXQ4hLf7fZp3jF2/qIPcowDLKmtwQQ+3ReVQ1RBSOK4/wv8tfl5WIvkE/weu2QpYUM+/xPDHk3JFkaKTleUxqTr3Q==',key_name='tempest-TestStampPattern-1197072316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dd81460e04ef0a3ef496334da5241',ramdisk_id='',reservation_id='r-yo4gu7q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1146793101',owner_user_name='tempest-TestStampPattern-1146793101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:21:28Z,user_data=None,user_id='53827b8c6b514b68987dd448fbc17bcd',uuid=a77934ca-8e15-4158-9d25-cd20427d5b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converting VIF {"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG os_vif [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca7a6873-899f-5232-ba2c-96e6402a80b8', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9de883-33, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a9de883-33, col_values=(('qos', UUID('f4a32b62-9ba5-4457-bded-9bad1d5da594')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a9de883-33, col_values=(('external_ids', {'iface-id': '1a9de883-33f2-4e14-8f36-702ceed50640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:fa:87', 'vm-uuid': 'a77934ca-8e15-4158-9d25-cd20427d5b07'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:21:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:30 user nova-compute[75097]: INFO os_vif [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33')
Nov 14 16:21:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:21:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No VIF found with MAC fa:16:3e:33:fa:87, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-2dd9994f-b7b5-4b9d-975d-290d42fd2c00 req-e0f08593-b7a9-4825-a324-3187e6ab8e9b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2dd9994f-b7b5-4b9d-975d-290d42fd2c00 req-e0f08593-b7a9-4825-a324-3187e6ab8e9b service nova] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2dd9994f-b7b5-4b9d-975d-290d42fd2c00 req-e0f08593-b7a9-4825-a324-3187e6ab8e9b service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2dd9994f-b7b5-4b9d-975d-290d42fd2c00 req-e0f08593-b7a9-4825-a324-3187e6ab8e9b service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-2dd9994f-b7b5-4b9d-975d-290d42fd2c00 req-e0f08593-b7a9-4825-a324-3187e6ab8e9b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] No waiting events found dispatching network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:21:31 user nova-compute[75097]: WARNING nova.compute.manager [req-2dd9994f-b7b5-4b9d-975d-290d42fd2c00 req-e0f08593-b7a9-4825-a324-3187e6ab8e9b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received unexpected event network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 for instance with vm_state building and task_state spawning.
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:21:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Instance spawned successfully.
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:21:33 user nova-compute[75097]: INFO nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:21:33 user nova-compute[75097]: INFO nova.compute.manager [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Took 5.95 seconds to build instance.
Nov 14 16:21:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acb2e4a9-8d17-4efd-846e-2479c6829d4e tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.042s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-74712271-ebbe-4a96-8c23-7b0071c67778 req-7f7c364b-dcf6-4182-8530-130c1cf80e8b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-74712271-ebbe-4a96-8c23-7b0071c67778 req-7f7c364b-dcf6-4182-8530-130c1cf80e8b service nova] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-74712271-ebbe-4a96-8c23-7b0071c67778 req-7f7c364b-dcf6-4182-8530-130c1cf80e8b service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-74712271-ebbe-4a96-8c23-7b0071c67778 req-7f7c364b-dcf6-4182-8530-130c1cf80e8b service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-74712271-ebbe-4a96-8c23-7b0071c67778 req-7f7c364b-dcf6-4182-8530-130c1cf80e8b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] No waiting events found dispatching network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:21:33 user nova-compute[75097]: WARNING nova.compute.manager [req-74712271-ebbe-4a96-8c23-7b0071c67778 req-7f7c364b-dcf6-4182-8530-130c1cf80e8b service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received unexpected event network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 for instance with vm_state active and task_state None.
Nov 14 16:21:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:21:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:21:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:48 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:21:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-changed-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Refreshing instance network info cache due to event network-changed-38a41d8f-7617-44be-9f7c-36169fc561ff. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] Acquiring lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] Acquired lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Refreshing network info cache for port 38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updated VIF entry in instance network info cache for port 38a41d8f-7617-44be-9f7c-36169fc561ff. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG nova.network.neutron [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating instance_info_cache with network_info: [{"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ef48cb5-e0b2-4007-a334-474fb92acdad req-15086332-2c51-4fea-b842-bf4870782915 service nova] Releasing lock "refresh_cache-825e2a70-e053-4a26-8c53-7b4d55ab3d3a" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'flavor' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:52 user nova-compute[75097]: INFO nova.compute.manager [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attaching volume ded1b2a4-a70f-42d7-9824-5037df8c5ab4 to /dev/vdb
Nov 14 16:21:52 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:21:52 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8288MB free_disk=25.01150894165039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG os_brick.utils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147c03b-78ee-4553-bd1e-345084fd097d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc40018d-0e16-4449-b32c-3e0527440dd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4e09c-73b2-471e-86bd-7858d9418a1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c080581a-d3b5-4e09-938f-869b689a5f33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:21:52 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:21:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4524400-7b6d-4db3-8031-c355ec056bea]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG os_brick.utils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating existing volume attachment record: eebac562-d484-420c-b9bf-fdc69d0c679c {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d608e55e-d0f0-47f8-8570-8741aed8aa2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:21:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:21:53 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:21:53 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:21:53 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:21:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:21:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:56 user nova-compute[75097]: INFO nova.compute.manager [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Terminating instance
Nov 14 16:21:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVDyAago', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:21:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:21:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:21:57 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5802e3a-158b-49d1-8ede-c7d0c248ced7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:21:57 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231e932-e63e-4f39-98eb-8290777c29e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4] added
Nov 14 16:21:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be53c9-9e17-4f7f-94fa-51ffbb969ed7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[197f4c17-bb0c-47af-8ccc-20df1b4f68a4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVDyAago {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVDyAago" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[65911f64-abf7-448c-a303-67cd4d391cf9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVDyAago'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9032ebee-71f6-4af3-a68a-f9fba02bf805]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b679989d-35c5-4622-b8d3-7a5e501742ef]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:21:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:21:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d6eef93-5e33-471a-a81a-1937439ad4c2 req-e4c685b3-f74e-40d5-8fad-fc0e5913c018 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-vif-unplugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d6eef93-5e33-471a-a81a-1937439ad4c2 req-e4c685b3-f74e-40d5-8fad-fc0e5913c018 service nova] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d6eef93-5e33-471a-a81a-1937439ad4c2 req-e4c685b3-f74e-40d5-8fad-fc0e5913c018 service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4d6eef93-5e33-471a-a81a-1937439ad4c2 req-e4c685b3-f74e-40d5-8fad-fc0e5913c018 service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d6eef93-5e33-471a-a81a-1937439ad4c2 req-e4c685b3-f74e-40d5-8fad-fc0e5913c018 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] No waiting events found dispatching network-vif-unplugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-4d6eef93-5e33-471a-a81a-1937439ad4c2 req-e4c685b3-f74e-40d5-8fad-fc0e5913c018 service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-vif-unplugged-ebf0b419-63dc-4f48-998f-08a87efc994a for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a146ba-11ca-4e53-a7d5-a80a6c13e574]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260]
Nov 14 16:21:57 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260] successful.
Nov 14 16:21:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403eba7-5b83-4967-b4b8-e483b02bdab8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad2b401-29b5-4d53-841f-6af0b3e1eb00]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:21:57 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:21:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:21:57 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:21:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c4a49-92b7-4fac-aba8-f733803672f2]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVDyAago', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Instance destroyed successfully.
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lazy-loading 'resources' on Instance uuid d608e55e-d0f0-47f8-8570-8741aed8aa2c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-406924323',display_name='tempest-VolumesActionsTest-instance-406924323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-406924323',id=34,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1049d85cb459183193d23a3cb60d3',ramdisk_id='',reservation_id='r-uhf94un5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1541833219',owner_user_name='tempest-VolumesActionsTest-1541833219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:20:12Z,user_data=None,user_id='2759dad7d2ed4ab998b1bb2a50269d6c',uuid=d608e55e-d0f0-47f8-8570-8741aed8aa2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converting VIF {"id": "ebf0b419-63dc-4f48-998f-08a87efc994a", "address": "fa:16:3e:18:6b:d3", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf0b419-63", "ovs_interfaceid": "ebf0b419-63dc-4f48-998f-08a87efc994a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG os_vif [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf0b419-63, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68bb4e60-c341-41b8-a6cd-93d07468e235) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:21:57 user nova-compute[75097]: INFO os_vif [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6b:d3,bridge_name='br-int',has_traffic_filtering=True,id=ebf0b419-63dc-4f48-998f-08a87efc994a,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf0b419-63')
Nov 14 16:21:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Deleting instance files /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c_del
Nov 14 16:21:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Deletion of /opt/stack/data/nova/instances/d608e55e-d0f0-47f8-8570-8741aed8aa2c_del complete
Nov 14 16:21:57 user nova-compute[75097]: INFO nova.compute.manager [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 16:21:57 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:21:57 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26362636163343131', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362636163343131', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.objects.instance [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'flavor' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:21:58 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:21:58 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:21:58 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:21:58 user nova-compute[75097]:   <serial>ded1b2a4-a70f-42d7-9824-5037df8c5ab4</serial>
Nov 14 16:21:58 user nova-compute[75097]: </disk>
Nov 14 16:21:58 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:21:58 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Took 0.61 seconds to deallocate network for instance.
Nov 14 16:21:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No VIF found with MAC fa:16:3e:48:f6:f7, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:58 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Deleted allocations for instance d608e55e-d0f0-47f8-8570-8741aed8aa2c
Nov 14 16:21:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-bb45a861-266f-4aca-b901-c83462b4a960 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8553b06d-0b49-4f35-9a20-a6ede2076237 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] Acquiring lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] Lock "d608e55e-d0f0-47f8-8570-8741aed8aa2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:21:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] No waiting events found dispatching network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:21:59 user nova-compute[75097]: WARNING nova.compute.manager [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received unexpected event network-vif-plugged-ebf0b419-63dc-4f48-998f-08a87efc994a for instance with vm_state deleted and task_state None.
Nov 14 16:21:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-b0eb6219-bcce-4e91-b2c5-3e24f19d77ca req-d0ecae82-039e-45fe-b67e-2dc22f8da7bb service nova] [instance: d608e55e-d0f0-47f8-8570-8741aed8aa2c] Received event network-vif-deleted-ebf0b419-63dc-4f48-998f-08a87efc994a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:22:02 user nova-compute[75097]: INFO nova.compute.claims [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Claim successful on node user
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:22:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:22:02 user nova-compute[75097]: INFO nova.virt.block_device [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Booting with volume-backed-image 8453bef7-6457-4331-abaa-62588e201fe1 at /dev/vda
Nov 14 16:22:02 user nova-compute[75097]: DEBUG nova.policy [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bb999bbbcf4d4c9058ea6921655732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aefeb20cd07a41f09d0c4e19e99518f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'flavor' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:03 user nova-compute[75097]: INFO nova.compute.manager [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attaching volume b9053d6a-38ee-433d-aacf-cacebd067614 to /dev/vdc
Nov 14 16:22:03 user nova-compute[75097]: DEBUG os_brick.utils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd35bc-339b-4c88-bfd5-764594c0c5d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5c5672-367b-48ad-81ab-e6ff78a38587]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[63906bf9-e987-4207-baed-a0ab10ebe76b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4ae01-235c-4c50-9f6a-46f0f08188f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:22:03 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:22:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f3a7e8-e174-4b82-87c7-c889a12621bf]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG os_brick.utils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating existing volume attachment record: 8880baaf-3448-400d-b734-f8e9b188eda9 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:22:03 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Successfully created port: 22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Successfully updated port: 22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-changed-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Refreshing instance network info cache due to event network-changed-22af481a-a342-44f4-9e02-e846c803b865. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] Acquiring lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updating instance_info_cache with network_info: [{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance network_info: |[{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] Acquired lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Refreshing network info cache for port 22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:22:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updated VIF entry in instance network info cache for port 22af481a-a342-44f4-9e02-e846c803b865. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:22:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updating instance_info_cache with network_info: [{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b410931-0589-4684-b82c-e1d82f2f297a req-1ba5e877-7c5c-497c-9b5c-bf7891eaf97f service nova] Releasing lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMIsTLWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:07 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:07 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:07 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c75433-127d-4d02-b3a1-ab4268811ddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:22:07 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42bfec-0b3d-4bcd-99bd-9b54a31a25eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614] added
Nov 14 16:22:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd17eaa-6339-4852-af54-99fe11be5541]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf88f6-75e8-497c-8cba-d597e09dbb24]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMIsTLWw {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMIsTLWw" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a1fea2-9d39-4e47-944d-0823dd6706fb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMIsTLWw'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3650a0b3-fe87-4814-95ed-edf65b9a6ae4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ccd683-ad8e-4e01-9ef6-d65c5a886a37]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b04888-e6c7-46ed-a5e4-8d84378c2933]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260]
Nov 14 16:22:08 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260] successful.
Nov 14 16:22:08 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a312c4-32bf-43c8-b139-a5c3d6dc1be5]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087be88-e52b-4930-90cc-3d5237983bc4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:08 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942dedf-6024-4f5c-9d1b-ab9d39821bd2]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.utils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509a647-8fc2-4449-b62f-53ae92466701]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a014f-9baa-497f-9f01-8db2bcac4bb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d58456d-feaa-4882-8a1f-31abae41eb80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c10cba-5786-49c0-a9c5-41423e22acb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:22:08 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:22:08 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51080a5-e7fc-4bdf-b27e-a269660d4224]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG os_brick.utils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:08 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updating existing volume attachment record: effa1e02-b9ac-44e1-bbad-68876334021a {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMIsTLWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23461313937373034', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461313937373034', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'flavor' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:22:09 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:22:09 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:22:09 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:22:09 user nova-compute[75097]:   <serial>b9053d6a-38ee-433d-aacf-cacebd067614</serial>
Nov 14 16:22:09 user nova-compute[75097]: </disk>
Nov 14 16:22:09 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] No VIF found with MAC fa:16:3e:48:f6:f7, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:22:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6aa4d24b-2a8d-4cd8-9578-bcca59b7709b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.351s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:10 user nova-compute[75097]: INFO nova.compute.manager [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Detaching volume b9053d6a-38ee-433d-aacf-cacebd067614
Nov 14 16:22:10 user nova-compute[75097]: INFO nova.virt.block_device [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attempting to driver detach volume b9053d6a-38ee-433d-aacf-cacebd067614 from mountpoint /dev/vdc
Nov 14 16:22:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Attempting to detach device vdc from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:22:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:22:10 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:22:10 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:22:10 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:22:10 user nova-compute[75097]:   <serial>b9053d6a-38ee-433d-aacf-cacebd067614</serial>
Nov 14 16:22:10 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 16:22:10 user nova-compute[75097]: </disk>
Nov 14 16:22:10 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:22:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Successfully detached device vdc from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the persistent domain config.
Nov 14 16:22:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:22:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:22:10 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:22:10 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:22:10 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:22:10 user nova-compute[75097]:   <serial>b9053d6a-38ee-433d-aacf-cacebd067614</serial>
Nov 14 16:22:10 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 16:22:10 user nova-compute[75097]: </disk>
Nov 14 16:22:10 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:22:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:22:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:22:13 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Creating image(s)
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Ensure instance console log exists: /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Start _get_guest_xml network_info=[{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94ce8238-e007-426f-9ad9-5d9a79ced856', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'serial': 'fa25e5b6-50cf-4b34-92d5-d2dcac9bf595'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'effa1e02-b9ac-44e1-bbad-68876334021a', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:22:13 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:13 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:13 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:13 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:13 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba760df-905a-4cb4-aa2b-107a394cd295]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:22:13 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[72923ddb-9b3f-4852-8b40-7fbe9c2eb79d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595] added
Nov 14 16:22:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[072062df-4dfd-4d75-a5b0-91ee6a856500]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b8b0aa-7238-474d-8f02-cf7aef8eec5a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huByacmC {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huByacmC" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[571a8f61-1ccf-4aa7-adfc-50cf1d9349ad]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'huByacmC'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6399e8e9-e3f6-4879-83ce-bf7e6416b68c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ad5b1-6e54-4bd1-84da-c9a1531c9c2b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5820cf1-491d-4685-bb4d-12a620fc0ef4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260]
Nov 14 16:22:13 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260] successful.
Nov 14 16:22:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51c3f1e-8cbe-4d83-b20a-f1489cf07fea]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ee4ef-3042-4048-8852-276184e28465]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:13 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ea948-0413-441b-a695-66a7c571c961]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:22:13 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26230376637656438', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230376637656438', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437597157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437597157',id=36,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-buxxzh1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:03Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=94ce8238-e007-426f-9ad9-5d9a79ced856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'pci_devices' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:22:14 user nova-compute[75097]:   <uuid>94ce8238-e007-426f-9ad9-5d9a79ced856</uuid>
Nov 14 16:22:14 user nova-compute[75097]:   <name>instance-00000024</name>
Nov 14 16:22:14 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:22:14 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:22:14 user nova-compute[75097]:   <metadata>
Nov 14 16:22:14 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:22:14 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:22:14 user nova-compute[75097]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-437597157</nova:name>
Nov 14 16:22:14 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:22:13</nova:creationTime>
Nov 14 16:22:14 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:22:14 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:22:14 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:22:14 user nova-compute[75097]:       <nova:owner>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:user uuid="b4bb999bbbcf4d4c9058ea6921655732">tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member</nova:user>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:project uuid="aefeb20cd07a41f09d0c4e19e99518f0">tempest-ServerBootFromVolumeStableRescueTest-1745607452</nova:project>
Nov 14 16:22:14 user nova-compute[75097]:       </nova:owner>
Nov 14 16:22:14 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:22:14 user nova-compute[75097]:       <nova:ports>
Nov 14 16:22:14 user nova-compute[75097]:         <nova:port uuid="22af481a-a342-44f4-9e02-e846c803b865">
Nov 14 16:22:14 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:22:14 user nova-compute[75097]:         </nova:port>
Nov 14 16:22:14 user nova-compute[75097]:       </nova:ports>
Nov 14 16:22:14 user nova-compute[75097]:     </nova:instance>
Nov 14 16:22:14 user nova-compute[75097]:   </metadata>
Nov 14 16:22:14 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:22:14 user nova-compute[75097]:     <system>
Nov 14 16:22:14 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:22:14 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:22:14 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:22:14 user nova-compute[75097]:       <entry name="serial">94ce8238-e007-426f-9ad9-5d9a79ced856</entry>
Nov 14 16:22:14 user nova-compute[75097]:       <entry name="uuid">94ce8238-e007-426f-9ad9-5d9a79ced856</entry>
Nov 14 16:22:14 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:22:14 user nova-compute[75097]:     </system>
Nov 14 16:22:14 user nova-compute[75097]:   </sysinfo>
Nov 14 16:22:14 user nova-compute[75097]:   <os>
Nov 14 16:22:14 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:22:14 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:22:14 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:22:14 user nova-compute[75097]:   </os>
Nov 14 16:22:14 user nova-compute[75097]:   <features>
Nov 14 16:22:14 user nova-compute[75097]:     <acpi/>
Nov 14 16:22:14 user nova-compute[75097]:     <apic/>
Nov 14 16:22:14 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:22:14 user nova-compute[75097]:   </features>
Nov 14 16:22:14 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:22:14 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:22:14 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:22:14 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:22:14 user nova-compute[75097]:   </clock>
Nov 14 16:22:14 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:22:14 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:22:14 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:22:14 user nova-compute[75097]:   </cpu>
Nov 14 16:22:14 user nova-compute[75097]:   <devices>
Nov 14 16:22:14 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:22:14 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:22:14 user nova-compute[75097]:       <source dev="/dev/sde"/>
Nov 14 16:22:14 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:22:14 user nova-compute[75097]:       <serial>fa25e5b6-50cf-4b34-92d5-d2dcac9bf595</serial>
Nov 14 16:22:14 user nova-compute[75097]:     </disk>
Nov 14 16:22:14 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:22:14 user nova-compute[75097]:       <mac address="fa:16:3e:46:c8:14"/>
Nov 14 16:22:14 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:22:14 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:22:14 user nova-compute[75097]:       <target dev="tap22af481a-a3"/>
Nov 14 16:22:14 user nova-compute[75097]:     </interface>
Nov 14 16:22:14 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:22:14 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/console.log" append="off"/>
Nov 14 16:22:14 user nova-compute[75097]:     </serial>
Nov 14 16:22:14 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:22:14 user nova-compute[75097]:     <video>
Nov 14 16:22:14 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:22:14 user nova-compute[75097]:     </video>
Nov 14 16:22:14 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:22:14 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:22:14 user nova-compute[75097]:     </rng>
Nov 14 16:22:14 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:22:14 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:22:14 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:22:14 user nova-compute[75097]:     </memballoon>
Nov 14 16:22:14 user nova-compute[75097]:   </devices>
Nov 14 16:22:14 user nova-compute[75097]: </domain>
Nov 14 16:22:14 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437597157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437597157',id=36,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-buxxzh1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:03Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=94ce8238-e007-426f-9ad9-5d9a79ced856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG os_vif [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80bc9f22-82ff-51c5-a3ab-305b8db0a049', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22af481a-a3, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22af481a-a3, col_values=(('qos', UUID('1d0c8986-4276-4001-ac64-051da1ea0dac')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22af481a-a3, col_values=(('external_ids', {'iface-id': '22af481a-a342-44f4-9e02-e846c803b865', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:c8:14', 'vm-uuid': '94ce8238-e007-426f-9ad9-5d9a79ced856'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:14 user nova-compute[75097]: INFO os_vif [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3')
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No VIF found with MAC fa:16:3e:46:c8:14, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:22:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-e258142b-de3b-4c57-980a-5f2fe64c6c4b req-9e2ff2ad-f6ba-44aa-a586-30a9658e8185 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e258142b-de3b-4c57-980a-5f2fe64c6c4b req-9e2ff2ad-f6ba-44aa-a586-30a9658e8185 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e258142b-de3b-4c57-980a-5f2fe64c6c4b req-9e2ff2ad-f6ba-44aa-a586-30a9658e8185 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e258142b-de3b-4c57-980a-5f2fe64c6c4b req-9e2ff2ad-f6ba-44aa-a586-30a9658e8185 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-e258142b-de3b-4c57-980a-5f2fe64c6c4b req-9e2ff2ad-f6ba-44aa-a586-30a9658e8185 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:22:16 user nova-compute[75097]: WARNING nova.compute.manager [req-e258142b-de3b-4c57-980a-5f2fe64c6c4b req-9e2ff2ad-f6ba-44aa-a586-30a9658e8185 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state building and task_state spawning.
Nov 14 16:22:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:16 user nova-compute[75097]: INFO nova.compute.manager [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Unshelving
Nov 14 16:22:17 user nova-compute[75097]: INFO nova.virt.block_device [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Booting with volume 49de22a7-a2b7-481b-929f-d1206136d383 at /dev/vdc
Nov 14 16:22:17 user nova-compute[75097]: DEBUG os_brick.utils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f44663-3b72-43c7-8133-0bdb353f50d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc43f9a8-e8d4-4eac-a9f7-f468624d1964]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb579df-a750-4b9d-801d-42c6c461d6a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3795f-853e-4aca-8165-a7bdcf7c9ac6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:22:17 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:22:17 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9979c-340f-4b56-8ff3-e324a0243105]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG os_brick.utils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:17 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating existing volume attachment record: e5b0ddd4-bec2-4fca-b82c-57da630ecdfb {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:22:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance spawned successfully.
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-06918f4f-0cf7-44c3-9f59-a9bc0d859c82 req-cad8b072-0d1e-4f43-b6f4-f3c74330de44 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-06918f4f-0cf7-44c3-9f59-a9bc0d859c82 req-cad8b072-0d1e-4f43-b6f4-f3c74330de44 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-06918f4f-0cf7-44c3-9f59-a9bc0d859c82 req-cad8b072-0d1e-4f43-b6f4-f3c74330de44 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-06918f4f-0cf7-44c3-9f59-a9bc0d859c82 req-cad8b072-0d1e-4f43-b6f4-f3c74330de44 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-06918f4f-0cf7-44c3-9f59-a9bc0d859c82 req-cad8b072-0d1e-4f43-b6f4-f3c74330de44 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:22:18 user nova-compute[75097]: WARNING nova.compute.manager [req-06918f4f-0cf7-44c3-9f59-a9bc0d859c82 req-cad8b072-0d1e-4f43-b6f4-f3c74330de44 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state building and task_state spawning.
Nov 14 16:22:18 user nova-compute[75097]: INFO nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 14 16:22:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:22:18 user nova-compute[75097]: INFO nova.compute.manager [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Took 15.83 seconds to build instance.
Nov 14 16:22:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c80efba2-2132-463a-bd0a-915e3c37a0aa tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.103s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:21 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'pci_requests' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:21 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'numa_topology' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:22:21 user nova-compute[75097]: INFO nova.compute.claims [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Claim successful on node user
Nov 14 16:22:22 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:22 user nova-compute[75097]: INFO nova.network.neutron [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating port abc26054-33f4-4cd1-8038-2d0737b45add with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing instance network info cache due to event network-changed-abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:22:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] Acquiring lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG nova.network.neutron [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:22:23 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Creating image(s)
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] Acquired lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG nova.network.neutron [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Refreshing network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG nova.objects.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<ba5d73ac-e962-4121-80c1-4d48077851ab> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "f25b8391e0a3085238f082606b49c54640153f82" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "f25b8391e0a3085238f082606b49c54640153f82" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.part --force-share --output=json" returned: 0 in 0.265s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG nova.virt.images [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] cb4a6acf-8d7c-4b91-bbfa-80668766a512 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.part /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG nova.network.neutron [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updated VIF entry in instance network info cache for port abc26054-33f4-4cd1-8038-2d0737b45add. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG nova.network.neutron [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b48575a-3a5d-408e-b4b4-c9284861826e req-5f02ad17-1d2e-4755-8338-c9f8629a4ab2 service nova] Releasing lock "refresh_cache-ba5d73ac-e962-4121-80c1-4d48077851ab" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.part /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.converted" returned: 0 in 0.331s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "f25b8391e0a3085238f082606b49c54640153f82" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.694s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "f25b8391e0a3085238f082606b49c54640153f82" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "f25b8391e0a3085238f082606b49c54640153f82" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82,backing_fmt=raw /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82,backing_fmt=raw /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk 1073741824" returned: 0 in 0.051s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "f25b8391e0a3085238f082606b49c54640153f82" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'migration_context' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:25 user nova-compute[75097]: DEBUG nova.objects.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<ba5d73ac-e962-4121-80c1-4d48077851ab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:22:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Rebasing disk image.
Nov 14 16:22:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.385s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee -F raw /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee -F raw /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk" returned: 0 in 1.982s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Ensure instance console log exists: /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Start _get_guest_xml network_info=[{"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='dac7a667aa6556627b9ef92e851d5d12',container_format='bare',created_at=2023-11-14T16:20:24Z,direct_url=<?>,disk_format='qcow2',id=cb4a6acf-8d7c-4b91-bbfa-80668766a512,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1026740153-shelved',owner='b644535e1a5b431e830a9d0aa10294e3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T16:20:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwGMfvIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ba5d73ac-e962-4121-80c1-4d48077851ab', 'attached_at': '', 'detached_at': '', 'volume_id': '49de22a7-a2b7-481b-929f-d1206136d383', 'serial': '49de22a7-a2b7-481b-929f-d1206136d383'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'e5b0ddd4-bec2-4fca-b82c-57da630ecdfb', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:22:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='dac7a667aa6556627b9ef92e851d5d12',container_format='bare',created_at=2023-11-14T16:20:24Z,direct_url=<?>,disk_format='qcow2',id=cb4a6acf-8d7c-4b91-bbfa-80668766a512,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1026740153-shelved',owner='b644535e1a5b431e830a9d0aa10294e3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T16:20:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.objects.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<ba5d73ac-e962-4121-80c1-4d48077851ab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwGMfvIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:28 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:28 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:28 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ee2a8-af0a-47ba-9a29-60443fccdc20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:22:28 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fecdb7-5658-4a57-8f03-2a93e3c29f47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383] added
Nov 14 16:22:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccc4ca2-6110-44fe-bba6-1ae556fe3155]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae78e35b-18a4-403b-bd6e-5b2b76d5d656]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwGMfvIF {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwGMfvIF" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5027b97a-29e5-4d98-acf2-54a840c763b1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rwGMfvIF'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f504ff-44e2-469c-aaa1-679166784ba5]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb038c2-7b24-4d77-9e78-35fe67e70893]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fdf98c-613e-4e17-998e-ffa911b0581e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260]
Nov 14 16:22:28 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260] successful.
Nov 14 16:22:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf42a52-875f-4f63-b751-f94a0ae4f61c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee95a406-496b-4e0a-a0a6-a0470d016345]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:22:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a35c665-0aa5-48b5-ad41-6d740c3eed51]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwGMfvIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23133613339366136', 'path': '/dev/sdf'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133613339366136', 'path': '/dev/sdf'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026740153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026740153',id=31,image_ref='cb4a6acf-8d7c-4b91-bbfa-80668766a512',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1809749550',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-r2hzputd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member',shelved_at='2023-11-14T16:20:28.859498',shelved_host='user',shelved_image_id='cb4a6acf-8d7c-4b91-bbfa-80668766a512'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=ba5d73ac-e962-4121-80c1-4d48077851ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.objects.instance [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'pci_devices' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.objects.base [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<ba5d73ac-e962-4121-80c1-4d48077851ab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:22:29 user nova-compute[75097]:   <uuid>ba5d73ac-e962-4121-80c1-4d48077851ab</uuid>
Nov 14 16:22:29 user nova-compute[75097]:   <name>instance-0000001f</name>
Nov 14 16:22:29 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:22:29 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:22:29 user nova-compute[75097]:   <metadata>
Nov 14 16:22:29 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:22:29 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:22:29 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1026740153</nova:name>
Nov 14 16:22:29 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:22:28</nova:creationTime>
Nov 14 16:22:29 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:22:29 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:22:29 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:22:29 user nova-compute[75097]:       <nova:owner>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:user uuid="eff36d66033f4331aa582c9fd2eab626">tempest-AttachVolumeShelveTestJSON-347532404-project-member</nova:user>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:project uuid="b644535e1a5b431e830a9d0aa10294e3">tempest-AttachVolumeShelveTestJSON-347532404</nova:project>
Nov 14 16:22:29 user nova-compute[75097]:       </nova:owner>
Nov 14 16:22:29 user nova-compute[75097]:       <nova:root type="image" uuid="cb4a6acf-8d7c-4b91-bbfa-80668766a512"/>
Nov 14 16:22:29 user nova-compute[75097]:       <nova:ports>
Nov 14 16:22:29 user nova-compute[75097]:         <nova:port uuid="abc26054-33f4-4cd1-8038-2d0737b45add">
Nov 14 16:22:29 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:22:29 user nova-compute[75097]:         </nova:port>
Nov 14 16:22:29 user nova-compute[75097]:       </nova:ports>
Nov 14 16:22:29 user nova-compute[75097]:     </nova:instance>
Nov 14 16:22:29 user nova-compute[75097]:   </metadata>
Nov 14 16:22:29 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:22:29 user nova-compute[75097]:     <system>
Nov 14 16:22:29 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:22:29 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:22:29 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:22:29 user nova-compute[75097]:       <entry name="serial">ba5d73ac-e962-4121-80c1-4d48077851ab</entry>
Nov 14 16:22:29 user nova-compute[75097]:       <entry name="uuid">ba5d73ac-e962-4121-80c1-4d48077851ab</entry>
Nov 14 16:22:29 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:22:29 user nova-compute[75097]:     </system>
Nov 14 16:22:29 user nova-compute[75097]:   </sysinfo>
Nov 14 16:22:29 user nova-compute[75097]:   <os>
Nov 14 16:22:29 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:22:29 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:22:29 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:22:29 user nova-compute[75097]:   </os>
Nov 14 16:22:29 user nova-compute[75097]:   <features>
Nov 14 16:22:29 user nova-compute[75097]:     <acpi/>
Nov 14 16:22:29 user nova-compute[75097]:     <apic/>
Nov 14 16:22:29 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:22:29 user nova-compute[75097]:   </features>
Nov 14 16:22:29 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:22:29 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:22:29 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:22:29 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:22:29 user nova-compute[75097]:   </clock>
Nov 14 16:22:29 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:22:29 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:22:29 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:22:29 user nova-compute[75097]:   </cpu>
Nov 14 16:22:29 user nova-compute[75097]:   <devices>
Nov 14 16:22:29 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:22:29 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:22:29 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk"/>
Nov 14 16:22:29 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:22:29 user nova-compute[75097]:     </disk>
Nov 14 16:22:29 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:22:29 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:22:29 user nova-compute[75097]:       <source dev="/dev/sdf"/>
Nov 14 16:22:29 user nova-compute[75097]:       <target dev="vdc" bus="virtio"/>
Nov 14 16:22:29 user nova-compute[75097]:       <serial>49de22a7-a2b7-481b-929f-d1206136d383</serial>
Nov 14 16:22:29 user nova-compute[75097]:     </disk>
Nov 14 16:22:29 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:22:29 user nova-compute[75097]:       <mac address="fa:16:3e:39:10:31"/>
Nov 14 16:22:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:22:29 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:22:29 user nova-compute[75097]:       <target dev="tapabc26054-33"/>
Nov 14 16:22:29 user nova-compute[75097]:     </interface>
Nov 14 16:22:29 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:22:29 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/console.log" append="off"/>
Nov 14 16:22:29 user nova-compute[75097]:     </serial>
Nov 14 16:22:29 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:22:29 user nova-compute[75097]:     <video>
Nov 14 16:22:29 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:22:29 user nova-compute[75097]:     </video>
Nov 14 16:22:29 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:22:29 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:22:29 user nova-compute[75097]:     </rng>
Nov 14 16:22:29 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:22:29 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:22:29 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:22:29 user nova-compute[75097]:     </memballoon>
Nov 14 16:22:29 user nova-compute[75097]:   </devices>
Nov 14 16:22:29 user nova-compute[75097]: </domain>
Nov 14 16:22:29 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026740153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026740153',id=31,image_ref='cb4a6acf-8d7c-4b91-bbfa-80668766a512',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1809749550',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-r2hzputd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member',shelved_at='2023-11-14T16:20:28.859498',shelved_host='user',shelved_image_id='cb4a6acf-8d7c-4b91-bbfa-80668766a512'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=ba5d73ac-e962-4121-80c1-4d48077851ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG os_vif [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f66edbb-5aa7-512e-a8e8-6363c171f161', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabc26054-33, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabc26054-33, col_values=(('qos', UUID('3683433c-a2db-4be3-95fc-cb3ad754c6ee')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabc26054-33, col_values=(('external_ids', {'iface-id': 'abc26054-33f4-4cd1-8038-2d0737b45add', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:10:31', 'vm-uuid': 'ba5d73ac-e962-4121-80c1-4d48077851ab'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:29 user nova-compute[75097]: INFO os_vif [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33')
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No VIF found with MAC fa:16:3e:39:10:31, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:22:30 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a is timed out.
Nov 14 16:22:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Successfully detached device vdc from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the live domain config.
Nov 14 16:22:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMIsTLWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:22:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cab6994-fb85-4f3d-96fb-1d9914ec2181]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:22:30 user nova-compute[75097]: No targets found.
Nov 14 16:22:30 user nova-compute[75097]: iSNS:
Nov 14 16:22:30 user nova-compute[75097]: No targets found.
Nov 14 16:22:30 user nova-compute[75097]: STATIC:
Nov 14 16:22:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:22:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:22:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:22:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4
Nov 14 16:22:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:22:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:22:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383
Nov 14 16:22:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:22:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:22:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614
Nov 14 16:22:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:22:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:22:30 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:22:30 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:22:30 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:22:30 user nova-compute[75097]: FIRMWARE:
Nov 14 16:22:30 user nova-compute[75097]: No targets found.
Nov 14 16:22:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:22:30 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:22:30 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd86b3a-ef09-4bc1-8114-36f142c55803]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8fb896-17d7-470c-aa9c-e1510dd8857c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:22:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98447a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b67681-2c40-4eb5-8dad-ef5708b756aa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27449a99-615c-4ee4-bf2e-1ed802120622]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5831041-52d5-4901-b6b9-04f2ba610467]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:22:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5655360f-4c53-4fdc-94ed-a45fc198589e]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e1971-e327-442c-a054-43350986132c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba08304-1bde-4e9c-85de-cb63081c5312]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260]
Nov 14 16:22:31 user nova-compute[75097]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614, portal: 172.16.0.220,3260] successful.
Nov 14 16:22:31 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-9c020375-d70b-4046-a9af-c8d8cb21d439 req-b805f687-be39-4e53-a076-2a89515a5fe4 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9c020375-d70b-4046-a9af-c8d8cb21d439 req-b805f687-be39-4e53-a076-2a89515a5fe4 service nova] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9c020375-d70b-4046-a9af-c8d8cb21d439 req-b805f687-be39-4e53-a076-2a89515a5fe4 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9c020375-d70b-4046-a9af-c8d8cb21d439 req-b805f687-be39-4e53-a076-2a89515a5fe4 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-9c020375-d70b-4046-a9af-c8d8cb21d439 req-b805f687-be39-4e53-a076-2a89515a5fe4 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] No waiting events found dispatching network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:22:31 user nova-compute[75097]: WARNING nova.compute.manager [req-9c020375-d70b-4046-a9af-c8d8cb21d439 req-b805f687-be39-4e53-a076-2a89515a5fe4 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received unexpected event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9053d6a-38ee-433d-aacf-cacebd067614 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f6c169-dad8-42c2-ba3b-88eece5c0cc2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] <== disconnect_volume: return (385ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:32 user nova-compute[75097]: DEBUG nova.objects.instance [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'flavor' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-34cd5da3-47dd-4967-8ca0-cd721994ebc7 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.989s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:22:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance spawned successfully.
Nov 14 16:22:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-64899213-daf2-4af6-a679-09ad44423665 req-70797f70-1ac7-48ac-a6e7-3d39db5c34c4 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-64899213-daf2-4af6-a679-09ad44423665 req-70797f70-1ac7-48ac-a6e7-3d39db5c34c4 service nova] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-64899213-daf2-4af6-a679-09ad44423665 req-70797f70-1ac7-48ac-a6e7-3d39db5c34c4 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-64899213-daf2-4af6-a679-09ad44423665 req-70797f70-1ac7-48ac-a6e7-3d39db5c34c4 service nova] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-64899213-daf2-4af6-a679-09ad44423665 req-70797f70-1ac7-48ac-a6e7-3d39db5c34c4 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] No waiting events found dispatching network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:22:33 user nova-compute[75097]: WARNING nova.compute.manager [req-64899213-daf2-4af6-a679-09ad44423665 req-70797f70-1ac7-48ac-a6e7-3d39db5c34c4 service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received unexpected event network-vif-plugged-abc26054-33f4-4cd1-8038-2d0737b45add for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 16:22:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:22:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-eecb75fa-e86f-4148-b3a2-93335c425c07 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.558s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "be1d215e-2281-4863-9df2-9ca20589bba3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:22:48 user nova-compute[75097]: INFO nova.compute.claims [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Claim successful on node user
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:22:48 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.policy [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2759dad7d2ed4ab998b1bb2a50269d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1049d85cb459183193d23a3cb60d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:22:48 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Creating image(s)
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "/opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "/opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "/opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk 1073741824" returned: 0 in 0.047s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Successfully created port: 873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Cannot resize image /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Ensure instance console log exists: /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:49 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Successfully updated port: 873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "refresh_cache-be1d215e-2281-4863-9df2-9ca20589bba3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquired lock "refresh_cache-be1d215e-2281-4863-9df2-9ca20589bba3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-changed-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Refreshing instance network info cache due to event network-changed-873dd03b-6295-4400-95c7-1e0dc4a0ba42. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] Acquiring lock "refresh_cache-be1d215e-2281-4863-9df2-9ca20589bba3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Updating instance_info_cache with network_info: [{"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Releasing lock "refresh_cache-be1d215e-2281-4863-9df2-9ca20589bba3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Instance network_info: |[{"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] Acquired lock "refresh_cache-be1d215e-2281-4863-9df2-9ca20589bba3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Refreshing network info cache for port 873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Start _get_guest_xml network_info=[{"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:22:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-976217407',display_name='tempest-VolumesActionsTest-instance-976217407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-976217407',id=37,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1049d85cb459183193d23a3cb60d3',ramdisk_id='',reservation_id='r-pklyi10z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1541833219',owner_user_name='tempest-VolumesActionsTest-1541833219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:49Z,user_data=None,user_id='2759dad7d2ed4ab998b1bb2a50269d6c',uuid=be1d215e-2281-4863-9df2-9ca20589bba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converting VIF {"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lazy-loading 'pci_devices' on Instance uuid be1d215e-2281-4863-9df2-9ca20589bba3 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:22:50 user nova-compute[75097]:   <uuid>be1d215e-2281-4863-9df2-9ca20589bba3</uuid>
Nov 14 16:22:50 user nova-compute[75097]:   <name>instance-00000025</name>
Nov 14 16:22:50 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:22:50 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:22:50 user nova-compute[75097]:   <metadata>
Nov 14 16:22:50 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:22:50 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:22:50 user nova-compute[75097]:       <nova:name>tempest-VolumesActionsTest-instance-976217407</nova:name>
Nov 14 16:22:50 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:22:50</nova:creationTime>
Nov 14 16:22:50 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:22:50 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:22:50 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:22:50 user nova-compute[75097]:       <nova:owner>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:user uuid="2759dad7d2ed4ab998b1bb2a50269d6c">tempest-VolumesActionsTest-1541833219-project-member</nova:user>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:project uuid="4ae1049d85cb459183193d23a3cb60d3">tempest-VolumesActionsTest-1541833219</nova:project>
Nov 14 16:22:50 user nova-compute[75097]:       </nova:owner>
Nov 14 16:22:50 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:22:50 user nova-compute[75097]:       <nova:ports>
Nov 14 16:22:50 user nova-compute[75097]:         <nova:port uuid="873dd03b-6295-4400-95c7-1e0dc4a0ba42">
Nov 14 16:22:50 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 16:22:50 user nova-compute[75097]:         </nova:port>
Nov 14 16:22:50 user nova-compute[75097]:       </nova:ports>
Nov 14 16:22:50 user nova-compute[75097]:     </nova:instance>
Nov 14 16:22:50 user nova-compute[75097]:   </metadata>
Nov 14 16:22:50 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:22:50 user nova-compute[75097]:     <system>
Nov 14 16:22:50 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:22:50 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:22:50 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:22:50 user nova-compute[75097]:       <entry name="serial">be1d215e-2281-4863-9df2-9ca20589bba3</entry>
Nov 14 16:22:50 user nova-compute[75097]:       <entry name="uuid">be1d215e-2281-4863-9df2-9ca20589bba3</entry>
Nov 14 16:22:50 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:22:50 user nova-compute[75097]:     </system>
Nov 14 16:22:50 user nova-compute[75097]:   </sysinfo>
Nov 14 16:22:50 user nova-compute[75097]:   <os>
Nov 14 16:22:50 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:22:50 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:22:50 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:22:50 user nova-compute[75097]:   </os>
Nov 14 16:22:50 user nova-compute[75097]:   <features>
Nov 14 16:22:50 user nova-compute[75097]:     <acpi/>
Nov 14 16:22:50 user nova-compute[75097]:     <apic/>
Nov 14 16:22:50 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:22:50 user nova-compute[75097]:   </features>
Nov 14 16:22:50 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:22:50 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:22:50 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:22:50 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:22:50 user nova-compute[75097]:   </clock>
Nov 14 16:22:50 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:22:50 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:22:50 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:22:50 user nova-compute[75097]:   </cpu>
Nov 14 16:22:50 user nova-compute[75097]:   <devices>
Nov 14 16:22:50 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:22:50 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:22:50 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk"/>
Nov 14 16:22:50 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:22:50 user nova-compute[75097]:     </disk>
Nov 14 16:22:50 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:22:50 user nova-compute[75097]:       <mac address="fa:16:3e:8a:ab:b9"/>
Nov 14 16:22:50 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:22:50 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:22:50 user nova-compute[75097]:       <target dev="tap873dd03b-62"/>
Nov 14 16:22:50 user nova-compute[75097]:     </interface>
Nov 14 16:22:50 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:22:50 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/console.log" append="off"/>
Nov 14 16:22:50 user nova-compute[75097]:     </serial>
Nov 14 16:22:50 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:22:50 user nova-compute[75097]:     <video>
Nov 14 16:22:50 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:22:50 user nova-compute[75097]:     </video>
Nov 14 16:22:50 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:22:50 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:22:50 user nova-compute[75097]:     </rng>
Nov 14 16:22:50 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:22:50 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:22:50 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:22:50 user nova-compute[75097]:     </memballoon>
Nov 14 16:22:50 user nova-compute[75097]:   </devices>
Nov 14 16:22:50 user nova-compute[75097]: </domain>
Nov 14 16:22:50 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-976217407',display_name='tempest-VolumesActionsTest-instance-976217407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-976217407',id=37,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1049d85cb459183193d23a3cb60d3',ramdisk_id='',reservation_id='r-pklyi10z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1541833219',owner_user_name='tempest-VolumesActionsTest-1541833219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:49Z,user_data=None,user_id='2759dad7d2ed4ab998b1bb2a50269d6c',uuid=be1d215e-2281-4863-9df2-9ca20589bba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converting VIF {"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG os_vif [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82aeaa3d-dd2f-5bf3-b95a-b630f9598c6a', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap873dd03b-62, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap873dd03b-62, col_values=(('qos', UUID('2da66119-4723-4a8a-ba81-5c44ea39a718')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap873dd03b-62, col_values=(('external_ids', {'iface-id': '873dd03b-6295-4400-95c7-1e0dc4a0ba42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:ab:b9', 'vm-uuid': 'be1d215e-2281-4863-9df2-9ca20589bba3'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:50 user nova-compute[75097]: INFO os_vif [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62')
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] No VIF found with MAC fa:16:3e:8a:ab:b9, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updating instance_info_cache with network_info: [{"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Updated VIF entry in instance network info cache for port 873dd03b-6295-4400-95c7-1e0dc4a0ba42. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Updating instance_info_cache with network_info: [{"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:22:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-93e5f8d0-6ebb-4cb5-9c2d-11ae6567fd66 req-a5d2265a-967c-43f9-82a2-c15e3268dbc8 service nova] Releasing lock "refresh_cache-be1d215e-2281-4863-9df2-9ca20589bba3" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:22:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-029941e9-6628-4bf7-bb61-47b548bcf897 req-f5d64a7d-7683-4e7c-9668-9595e3ee96c1 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-029941e9-6628-4bf7-bb61-47b548bcf897 req-f5d64a7d-7683-4e7c-9668-9595e3ee96c1 service nova] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-029941e9-6628-4bf7-bb61-47b548bcf897 req-f5d64a7d-7683-4e7c-9668-9595e3ee96c1 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-029941e9-6628-4bf7-bb61-47b548bcf897 req-f5d64a7d-7683-4e7c-9668-9595e3ee96c1 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-029941e9-6628-4bf7-bb61-47b548bcf897 req-f5d64a7d-7683-4e7c-9668-9595e3ee96c1 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] No waiting events found dispatching network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:22:52 user nova-compute[75097]: WARNING nova.compute.manager [req-029941e9-6628-4bf7-bb61-47b548bcf897 req-f5d64a7d-7683-4e7c-9668-9595e3ee96c1 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received unexpected event network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 for instance with vm_state building and task_state spawning.
Nov 14 16:22:52 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:22:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:22:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Instance spawned successfully.
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:54 user nova-compute[75097]: INFO nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-4956559b-740d-431a-af11-9028e3a901cd req-4a156fdd-7bf0-4e81-b5a5-58d5d5907586 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4956559b-740d-431a-af11-9028e3a901cd req-4a156fdd-7bf0-4e81-b5a5-58d5d5907586 service nova] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4956559b-740d-431a-af11-9028e3a901cd req-4a156fdd-7bf0-4e81-b5a5-58d5d5907586 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4956559b-740d-431a-af11-9028e3a901cd req-4a156fdd-7bf0-4e81-b5a5-58d5d5907586 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-4956559b-740d-431a-af11-9028e3a901cd req-4a156fdd-7bf0-4e81-b5a5-58d5d5907586 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] No waiting events found dispatching network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:22:54 user nova-compute[75097]: WARNING nova.compute.manager [req-4956559b-740d-431a-af11-9028e3a901cd req-4a156fdd-7bf0-4e81-b5a5-58d5d5907586 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received unexpected event network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 for instance with vm_state building and task_state spawning.
Nov 14 16:22:54 user nova-compute[75097]: INFO nova.compute.manager [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Took 6.02 seconds to build instance.
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6be78470-9e6b-42c5-a529-b90fcf771b5f tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "be1d215e-2281-4863-9df2-9ca20589bba3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.139s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:22:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:22:55 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:55 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8036MB free_disk=24.992958068847656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94ce8238-e007-426f-9ad9-5d9a79ced856 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ba5d73ac-e962-4121-80c1-4d48077851ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance be1d215e-2281-4863-9df2-9ca20589bba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:22:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:22:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:22:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:22:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:00 user nova-compute[75097]: INFO nova.compute.manager [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Detaching volume ded1b2a4-a70f-42d7-9824-5037df8c5ab4
Nov 14 16:23:00 user nova-compute[75097]: INFO nova.virt.block_device [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Attempting to driver detach volume ded1b2a4-a70f-42d7-9824-5037df8c5ab4 from mountpoint /dev/vdb
Nov 14 16:23:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Attempting to detach device vdb from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:23:00 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:23:00 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:23:00 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:23:00 user nova-compute[75097]:   <serial>ded1b2a4-a70f-42d7-9824-5037df8c5ab4</serial>
Nov 14 16:23:00 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:23:00 user nova-compute[75097]: </disk>
Nov 14 16:23:00 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:23:00 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Successfully detached device vdb from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the persistent domain config.
Nov 14 16:23:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:23:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:23:00 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:23:00 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:23:00 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:23:00 user nova-compute[75097]:   <serial>ded1b2a4-a70f-42d7-9824-5037df8c5ab4</serial>
Nov 14 16:23:00 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:23:00 user nova-compute[75097]: </disk>
Nov 14 16:23:00 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:23:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:23:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-changed-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Refreshing instance network info cache due to event network-changed-1a9de883-33f2-4e14-8f36-702ceed50640. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:23:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] Acquiring lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:23:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] Acquired lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:23:19 user nova-compute[75097]: DEBUG nova.network.neutron [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Refreshing network info cache for port 1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG nova.network.neutron [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updated VIF entry in instance network info cache for port 1a9de883-33f2-4e14-8f36-702ceed50640. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG nova.network.neutron [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [{"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6068f16a-9e2f-4c91-ae2d-177154ff9126 req-f2929cbd-c36f-400c-9d88-8a7027545197 service nova] Releasing lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'flavor' on Instance uuid a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:20 user nova-compute[75097]: INFO nova.compute.manager [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Attaching volume 56f8a292-663b-4f15-a8dd-d20de953a32b to /dev/vdb
Nov 14 16:23:20 user nova-compute[75097]: DEBUG os_brick.utils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d77b0-c917-4c72-b8b2-3e52eecfb63b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c465e1a7-91f0-47d6-9089-e1546d4cbcb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[640e87ee-f7cc-440b-a0a1-d42c2f35d566]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e740cbf4-79f3-49e5-adc9-f2f4f9e3c318]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:23:20 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:23:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd138560-9eea-4b3a-b6ca-b685cf155f9f]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG os_brick.utils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:23:20 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating existing volume attachment record: e7b20f97-3ee8-4c96-9b97-9fd94bf6cc1f {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:23:21 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a is timed out.
Nov 14 16:23:21 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Successfully detached device vdb from instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a from the live domain config.
Nov 14 16:23:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVDyAago', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:23:21 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae09549-499a-4a0d-88a8-8d8ed2e73e91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:23:21 user nova-compute[75097]: No targets found.
Nov 14 16:23:21 user nova-compute[75097]: iSNS:
Nov 14 16:23:21 user nova-compute[75097]: No targets found.
Nov 14 16:23:21 user nova-compute[75097]: STATIC:
Nov 14 16:23:21 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:23:21 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:21 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:21 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4
Nov 14 16:23:21 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:21 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:21 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383
Nov 14 16:23:21 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:21 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:21 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:23:21 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:21 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:21 user nova-compute[75097]: FIRMWARE:
Nov 14 16:23:21 user nova-compute[75097]: No targets found.
Nov 14 16:23:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:23:21 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:23:21 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a26efbd-c47a-41cf-b279-938e15f67aa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8438997-cc40-4f88-9403-40ccfb0c5a84]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98445870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef98dd36-d527-4356-b3d8-f7dddfd35e13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[910f8e8a-d60e-4a66-9f3e-4b09a3f98a45]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c1fd8-d069-490d-a28a-d6ea13abf132]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1ecfe8-6b5f-40db-8c32-018a44c4a45c]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61480f0-eba5-4a32-bdf7-4843edad05e7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a80d3f-d9d2-4ced-8727-f6fd4b6add1c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260]
Nov 14 16:23:21 user nova-compute[75097]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4, portal: 172.16.0.220,3260] successful.
Nov 14 16:23:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1b2a4-a70f-42d7-9824-5037df8c5ab4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20d552b-5c0f-4977-9b9a-6e080d1ff21c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] <== disconnect_volume: return (313ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:23:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'flavor' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6a6053b5-462a-4340-b563-e28c0c52b805 tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.553s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMROozNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:23:25 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:23:25 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:23:25 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b595782-fcc0-4b3a-a2d8-7de7698a4c36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:23:25 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07c199d-9981-4f16-823d-39cfdba30d39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b] added
Nov 14 16:23:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.146s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f185c88-3955-42b7-8bdd-f13a7bf3ce08]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e5f50a-fe42-4f4b-b7df-b274c7eee685]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMROozNK {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMROozNK" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a88e78-2e33-487f-bcd7-cceb58892208]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMROozNK'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5339616c-cd52-4a5e-8c27-c7d9adc1a429]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0afb58-4c26-4294-b21e-7789e1fca061]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3936a9e0-69ba-4bd7-a7aa-0907ec2ed791]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260]
Nov 14 16:23:25 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260] successful.
Nov 14 16:23:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[163130e7-cc38-4bd4-a57d-2e94de6d3b0d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a305da71-eab7-46d6-804b-86e2ab5afe9f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b (non-flash)
Nov 14 16:23:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:25 user nova-compute[75097]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b (non-flash)
Nov 14 16:23:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48899b52-15ce-49ce-939c-45f96dbcfd52]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:23:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMROozNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26636326333366630', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636326333366630', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'flavor' on Instance uuid a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:23:26 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:23:26 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:23:26 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:23:26 user nova-compute[75097]:   <serial>56f8a292-663b-4f15-a8dd-d20de953a32b</serial>
Nov 14 16:23:26 user nova-compute[75097]: </disk>
Nov 14 16:23:26 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:23:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No VIF found with MAC fa:16:3e:33:fa:87, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:23:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f379d58b-05a1-4f06-a0b7-f7bb50d30f6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.676s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:29 user nova-compute[75097]: INFO nova.compute.manager [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Detaching volume 56f8a292-663b-4f15-a8dd-d20de953a32b
Nov 14 16:23:29 user nova-compute[75097]: INFO nova.virt.block_device [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Attempting to driver detach volume 56f8a292-663b-4f15-a8dd-d20de953a32b from mountpoint /dev/vdb
Nov 14 16:23:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Attempting to detach device vdb from instance a77934ca-8e15-4158-9d25-cd20427d5b07 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:23:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:23:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:23:29 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:23:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:23:29 user nova-compute[75097]:   <serial>56f8a292-663b-4f15-a8dd-d20de953a32b</serial>
Nov 14 16:23:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:23:29 user nova-compute[75097]: </disk>
Nov 14 16:23:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:23:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully detached device vdb from instance a77934ca-8e15-4158-9d25-cd20427d5b07 from the persistent domain config.
Nov 14 16:23:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a77934ca-8e15-4158-9d25-cd20427d5b07 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:23:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:23:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:23:29 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:23:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:23:29 user nova-compute[75097]:   <serial>56f8a292-663b-4f15-a8dd-d20de953a32b</serial>
Nov 14 16:23:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:23:29 user nova-compute[75097]: </disk>
Nov 14 16:23:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:23:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:23:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:23:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a77934ca-8e15-4158-9d25-cd20427d5b07 is timed out.
Nov 14 16:23:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully detached device vdb from instance a77934ca-8e15-4158-9d25-cd20427d5b07 from the live domain config.
Nov 14 16:23:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMROozNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:23:50 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec65de3-7007-43ad-9bb6-1c64464c420a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:23:50 user nova-compute[75097]: No targets found.
Nov 14 16:23:50 user nova-compute[75097]: iSNS:
Nov 14 16:23:50 user nova-compute[75097]: No targets found.
Nov 14 16:23:50 user nova-compute[75097]: STATIC:
Nov 14 16:23:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:23:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b
Nov 14 16:23:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383
Nov 14 16:23:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:23:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:23:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:23:50 user nova-compute[75097]: FIRMWARE:
Nov 14 16:23:50 user nova-compute[75097]: No targets found.
Nov 14 16:23:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:23:50 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:23:50 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c8019-8150-4bbe-91b3-df3e07008ddb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c4b90a-b7e1-4ac1-ab03-250abce9ddb5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:50 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:50 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:50 user nova-compute[75097]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b (non-flash)
Nov 14 16:23:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:50 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:50 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:50 user nova-compute[75097]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b (non-flash)
Nov 14 16:23:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98445750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77068a5-d8ae-41bf-a5e9-c7e016a2372f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3616675-b1a5-4e05-88c3-7538823a8320]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cbe464-9ef8-4b85-a978-380494a17989]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42bf4a7-efc1-47ed-85e6-2e5a9999a4e9]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8554fc9-491f-4cb1-952e-9bdfe9ee324d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b31eb2-efc6-4841-8763-f42e18220a26]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260]
Nov 14 16:23:50 user nova-compute[75097]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b, portal: 172.16.0.220,3260] successful.
Nov 14 16:23:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f8a292-663b-4f15-a8dd-d20de953a32b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[774fdf43-0dbf-42cc-8d3f-5b13293adc91]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] <== disconnect_volume: return (313ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:50 user nova-compute[75097]: INFO nova.compute.manager [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Terminating instance
Nov 14 16:23:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:23:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-de1eefd3-88b7-47df-96a7-eea733e7fb23 req-6931ecc5-61c3-4036-b702-c37712f6972a service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-vif-unplugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-de1eefd3-88b7-47df-96a7-eea733e7fb23 req-6931ecc5-61c3-4036-b702-c37712f6972a service nova] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-de1eefd3-88b7-47df-96a7-eea733e7fb23 req-6931ecc5-61c3-4036-b702-c37712f6972a service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-de1eefd3-88b7-47df-96a7-eea733e7fb23 req-6931ecc5-61c3-4036-b702-c37712f6972a service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-de1eefd3-88b7-47df-96a7-eea733e7fb23 req-6931ecc5-61c3-4036-b702-c37712f6972a service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] No waiting events found dispatching network-vif-unplugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-de1eefd3-88b7-47df-96a7-eea733e7fb23 req-6931ecc5-61c3-4036-b702-c37712f6972a service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-vif-unplugged-38a41d8f-7617-44be-9f7c-36169fc561ff for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Skipping network cache update for instance because it is being deleted. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'flavor' on Instance uuid a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-fa27d4f2-b492-4a29-b69b-201f09f59462 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Instance destroyed successfully.
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lazy-loading 'resources' on Instance uuid 825e2a70-e053-4a26-8c53-7b4d55ab3d3a {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1846401003',display_name='tempest-TestServerVolumeAttachmentScenario-server-1846401003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1846401003',id=33,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNewxPGylDRHyoiw1xiChnZQYvVsKA6dp7ljwzsZPtvGbwt1o3QFVxpYsNixGOArLEJMHZKZyf2y21Id/ECpz88piwM710ag54sDeSDk+SOzUAfWEkJ9qLxrZMr9nxyP2Q==',key_name='tempest-keypair-514708361',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79cc6026624f4cc09811ef897515bf36',ramdisk_id='',reservation_id='r-0efc2i20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1559548981',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1559548981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:20:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6cf5cedfb85437c896b8345d0a4dc18',uuid=825e2a70-e053-4a26-8c53-7b4d55ab3d3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Converting VIF {"id": "38a41d8f-7617-44be-9f7c-36169fc561ff", "address": "fa:16:3e:48:f6:f7", "network": {"id": "d674e938-0633-4a35-8db8-25718c9e40e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425952620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79cc6026624f4cc09811ef897515bf36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a41d8f-76", "ovs_interfaceid": "38a41d8f-7617-44be-9f7c-36169fc561ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG os_vif [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a41d8f-76, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3931e6a1-5349-4a26-87e8-61a5955f848c) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:23:51 user nova-compute[75097]: INFO os_vif [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:f6:f7,bridge_name='br-int',has_traffic_filtering=True,id=38a41d8f-7617-44be-9f7c-36169fc561ff,network=Network(d674e938-0633-4a35-8db8-25718c9e40e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a41d8f-76')
Nov 14 16:23:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Deleting instance files /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a_del
Nov 14 16:23:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Deletion of /opt/stack/data/nova/instances/825e2a70-e053-4a26-8c53-7b4d55ab3d3a_del complete
Nov 14 16:23:51 user nova-compute[75097]: INFO nova.compute.manager [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 16:23:51 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:23:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:23:52 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Took 0.88 seconds to deallocate network for instance.
Nov 14 16:23:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-0de7f77f-588c-4f53-ab82-0f1b5655f9eb req-e300ba21-7eae-4e70-9cd1-96319e3c8eb4 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-vif-deleted-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:52 user nova-compute[75097]: INFO nova.compute.manager [req-0de7f77f-588c-4f53-ab82-0f1b5655f9eb req-e300ba21-7eae-4e70-9cd1-96319e3c8eb4 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Neutron deleted interface 38a41d8f-7617-44be-9f7c-36169fc561ff; detaching it from the instance and deleting it from the info cache
Nov 14 16:23:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-0de7f77f-588c-4f53-ab82-0f1b5655f9eb req-e300ba21-7eae-4e70-9cd1-96319e3c8eb4 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-0de7f77f-588c-4f53-ab82-0f1b5655f9eb req-e300ba21-7eae-4e70-9cd1-96319e3c8eb4 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Detach interface failed, port_id=38a41d8f-7617-44be-9f7c-36169fc561ff, reason: Instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:53 user nova-compute[75097]: INFO nova.compute.manager [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Rescuing
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:23:53 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Deleted allocations for instance 825e2a70-e053-4a26-8c53-7b4d55ab3d3a
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-a13ae5ea-305d-4f8b-a91f-9355cf624d7c req-5b768646-9256-4528-8759-6265eab71e39 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received event network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a13ae5ea-305d-4f8b-a91f-9355cf624d7c req-5b768646-9256-4528-8759-6265eab71e39 service nova] Acquiring lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a13ae5ea-305d-4f8b-a91f-9355cf624d7c req-5b768646-9256-4528-8759-6265eab71e39 service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a13ae5ea-305d-4f8b-a91f-9355cf624d7c req-5b768646-9256-4528-8759-6265eab71e39 service nova] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-a13ae5ea-305d-4f8b-a91f-9355cf624d7c req-5b768646-9256-4528-8759-6265eab71e39 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] No waiting events found dispatching network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:23:53 user nova-compute[75097]: WARNING nova.compute.manager [req-a13ae5ea-305d-4f8b-a91f-9355cf624d7c req-5b768646-9256-4528-8759-6265eab71e39 service nova] [instance: 825e2a70-e053-4a26-8c53-7b4d55ab3d3a] Received unexpected event network-vif-plugged-38a41d8f-7617-44be-9f7c-36169fc561ff for instance with vm_state deleted and task_state None.
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-48e26f7b-2810-4ea7-bdeb-44f9b420002b tempest-TestServerVolumeAttachmentScenario-1559548981 tempest-TestServerVolumeAttachmentScenario-1559548981-project-member] Lock "825e2a70-e053-4a26-8c53-7b4d55ab3d3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updating instance_info_cache with network_info: [{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:23:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:23:54 user nova-compute[75097]: WARNING nova.compute.manager [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state active and task_state rescuing.
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:23:54 user nova-compute[75097]: WARNING nova.compute.manager [req-62b53d25-fb08-4f4c-8e85-8ea5964d95df req-c0452afd-6958-44ba-862b-b4eed8767df4 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state active and task_state rescuing.
Nov 14 16:23:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:23:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8121MB free_disk=24.991077423095703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance destroyed successfully.
Nov 14 16:23:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Attempting a stable device rescue
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75097) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:23:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Creating image(s)
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "/opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "/opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "3c994e2a306861d047867240bc23ce0e59172073" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "3c994e2a306861d047867240bc23ce0e59172073" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94ce8238-e007-426f-9ad9-5d9a79ced856 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ba5d73ac-e962-4121-80c1-4d48077851ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance be1d215e-2281-4863-9df2-9ca20589bba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:23:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:23:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.images [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] e3477762-8d00-469e-89d3-b00b51e61e67 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.part /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.443s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.part /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.converted" returned: 0 in 0.311s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "3c994e2a306861d047867240bc23ce0e59172073" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.782s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "3c994e2a306861d047867240bc23ce0e59172073" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "3c994e2a306861d047867240bc23ce0e59172073" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073 --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073,backing_fmt=raw /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073,backing_fmt=raw /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue" returned: 0 in 0.046s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "3c994e2a306861d047867240bc23ce0e59172073" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'migration_context' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<94ce8238-e007-426f-9ad9-5d9a79ced856> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Start _get_guest_xml network_info=[{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "vif_mac": "fa:16:3e:46:c8:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3477762-8d00-469e-89d3-b00b51e61e67', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '94ce8238-e007-426f-9ad9-5d9a79ced856', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'serial': 'fa25e5b6-50cf-4b34-92d5-d2dcac9bf595'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'effa1e02-b9ac-44e1-bbad-68876334021a', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'resources' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<94ce8238-e007-426f-9ad9-5d9a79ced856> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'numa_topology' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<94ce8238-e007-426f-9ad9-5d9a79ced856> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:23:56 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:23:56 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:23:56 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.objects.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<94ce8238-e007-426f-9ad9-5d9a79ced856> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:23:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:23:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:23:57 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cca07d-2ca0-4746-ab25-47c4e697a26a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = huByacmC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 16:23:57 user nova-compute[75097]: node.name = iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:23:57 user nova-compute[75097]: node.tpgt = -1
Nov 14 16:23:57 user nova-compute[75097]: node.startup = automatic
Nov 14 16:23:57 user nova-compute[75097]: node.leading_login = No
Nov 14 16:23:57 user nova-compute[75097]: iface.iscsi_ifacename = default
Nov 14 16:23:57 user nova-compute[75097]: iface.net_ifacename = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.ipaddress = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.prefix_len = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.hwaddress = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.transport_name = tcp
Nov 14 16:23:57 user nova-compute[75097]: iface.initiatorname = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.vlan_id = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.vlan_priority = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.vlan_state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.iface_num = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.mtu = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.port = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.bootproto = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.subnet_mask = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.gateway = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_alt_client_id = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_dns = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_learn_iqn = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_vendor_id_state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_vendor_id = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.dhcp_slp_da = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.fragmentation = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.gratuitous_arp = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.incoming_forwarding = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.tos_state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.tos = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.ttl = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.delayed_ack = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.tcp_nagle = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.tcp_wsf_state = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.tcp_wsf = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.tcp_timer_scale = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.tcp_timestamp = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.redirect = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.def_task_mgmt_timeout = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.header_digest = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.data_digest = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.immediate_data = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.initial_r2t = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.data_seq_inorder = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.data_pdu_inorder = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.erl = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.max_receive_data_len = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.first_burst_len = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.max_outstanding_r2t = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.max_burst_len = 0
Nov 14 16:23:57 user nova-compute[75097]: iface.chap_auth = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.bidi_chap = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.strict_login_compliance = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.discovery_auth = <empty>
Nov 14 16:23:57 user nova-compute[75097]: iface.discovery_logout = <empty>
Nov 14 16:23:57 user nova-compute[75097]: node.discovery_address = <empty>
Nov 14 16:23:57 user nova-compute[75097]: node.discovery_port = 0
Nov 14 16:23:57 user nova-compute[75097]: node.discovery_type = static
Nov 14 16:23:57 user nova-compute[75097]: node.session.initial_cmdsn = 0
Nov 14 16:23:57 user nova-compute[75097]: node.session.initial_login_retry_max = 8
Nov 14 16:23:57 user nova-compute[75097]: node.session.xmit_thread_priority = -20
Nov 14 16:23:57 user nova-compute[75097]: node.session.cmds_max = 128
Nov 14 16:23:57 user nova-compute[75097]: node.session.queue_depth = 32
Nov 14 16:23:57 user nova-compute[75097]: node.session.nr_sessions = 1
Nov 14 16:23:57 user nova-compute[75097]: node.session.auth.authmethod = CHAP
Nov 14 16:23:57 user nova-compute[75097]: node.session.auth.username = huByacmC
Nov 14 16:23:57 user nova-compute[75097]: node.session.auth.password = ***
Nov 14 16:23:57 user nova-compute[75097]: node.session.auth.username_in = <empty>
Nov 14 16:23:57 user nova-compute[75097]: node.session.auth.password_in = <empty>
Nov 14 16:23:57 user nova-compute[75097]: node.session.auth.chap_algs = MD5
Nov 14 16:23:57 user nova-compute[75097]: node.session.timeo.replacement_timeout = 120
Nov 14 16:23:57 user nova-compute[75097]: node.session.err_timeo.abort_timeout = 15
Nov 14 16:23:57 user nova-compute[75097]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 16:23:57 user nova-compute[75097]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 16:23:57 user nova-compute[75097]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.FastAbort = Yes
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.InitialR2T = No
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.ImmediateData = Yes
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.MaxConnections = 1
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 16:23:57 user nova-compute[75097]: node.session.iscsi.ERL = 0
Nov 14 16:23:57 user nova-compute[75097]: node.session.scan = manual
Nov 14 16:23:57 user nova-compute[75097]: node.session.reopen_max = 0
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].address = 172.16.0.220
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].port = 3260
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].startup = manual
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].tcp.window_size = 524288
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].tcp.type_of_service = 0
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].timeo.logout_timeout = 15
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].timeo.login_timeout = 15
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].timeo.auth_timeout = 45
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].iscsi.DataDigest = None
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].iscsi.IFMarker = No
Nov 14 16:23:57 user nova-compute[75097]: node.conn[0].iscsi.OFMarker = No
Nov 14 16:23:57 user nova-compute[75097]: # END RECORD
Nov 14 16:23:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c64007-e348-44cc-9711-a39b5850f6fe]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e1926-8768-4590-ad02-5ea64d635edc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huByacmC {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v huByacmC" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafe78b8-df4f-4b03-8512-de1fd3af5616]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'huByacmC'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c7536c-7f70-441c-9755-8a88152de609]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ffe889-3faa-4ea2-ab22-b0ff9b684920]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:57 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:57 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:23:57 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:23:57 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:23:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] HCTL ('36', '0', '0', 0) found on session 41 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9caf58-adee-4c05-840c-abff3eeb5dbc]: (4, ('0 0 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Searching for a device in session 41 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '26230376637656438', 'path': '/dev/sde'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230376637656438', 'path': '/dev/sde'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437597157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437597157',id=36,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:22:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-buxxzh1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:22:18Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=94ce8238-e007-426f-9ad9-5d9a79ced856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "vif_mac": "fa:16:3e:46:c8:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "vif_mac": "fa:16:3e:46:c8:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'pci_devices' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.objects.base [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Object Instance<94ce8238-e007-426f-9ad9-5d9a79ced856> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:23:57 user nova-compute[75097]:   <uuid>94ce8238-e007-426f-9ad9-5d9a79ced856</uuid>
Nov 14 16:23:57 user nova-compute[75097]:   <name>instance-00000024</name>
Nov 14 16:23:57 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:23:57 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:23:57 user nova-compute[75097]:   <metadata>
Nov 14 16:23:57 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:23:57 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:23:57 user nova-compute[75097]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-437597157</nova:name>
Nov 14 16:23:57 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:23:56</nova:creationTime>
Nov 14 16:23:57 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:23:57 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:23:57 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:23:57 user nova-compute[75097]:       <nova:owner>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:user uuid="b4bb999bbbcf4d4c9058ea6921655732">tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member</nova:user>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:project uuid="aefeb20cd07a41f09d0c4e19e99518f0">tempest-ServerBootFromVolumeStableRescueTest-1745607452</nova:project>
Nov 14 16:23:57 user nova-compute[75097]:       </nova:owner>
Nov 14 16:23:57 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:23:57 user nova-compute[75097]:       <nova:ports>
Nov 14 16:23:57 user nova-compute[75097]:         <nova:port uuid="22af481a-a342-44f4-9e02-e846c803b865">
Nov 14 16:23:57 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:23:57 user nova-compute[75097]:         </nova:port>
Nov 14 16:23:57 user nova-compute[75097]:       </nova:ports>
Nov 14 16:23:57 user nova-compute[75097]:     </nova:instance>
Nov 14 16:23:57 user nova-compute[75097]:   </metadata>
Nov 14 16:23:57 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:23:57 user nova-compute[75097]:     <system>
Nov 14 16:23:57 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:23:57 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:23:57 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:23:57 user nova-compute[75097]:       <entry name="serial">94ce8238-e007-426f-9ad9-5d9a79ced856</entry>
Nov 14 16:23:57 user nova-compute[75097]:       <entry name="uuid">94ce8238-e007-426f-9ad9-5d9a79ced856</entry>
Nov 14 16:23:57 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:23:57 user nova-compute[75097]:     </system>
Nov 14 16:23:57 user nova-compute[75097]:   </sysinfo>
Nov 14 16:23:57 user nova-compute[75097]:   <os>
Nov 14 16:23:57 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:23:57 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:23:57 user nova-compute[75097]:   </os>
Nov 14 16:23:57 user nova-compute[75097]:   <features>
Nov 14 16:23:57 user nova-compute[75097]:     <acpi/>
Nov 14 16:23:57 user nova-compute[75097]:     <apic/>
Nov 14 16:23:57 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:23:57 user nova-compute[75097]:   </features>
Nov 14 16:23:57 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:23:57 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:23:57 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:23:57 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:23:57 user nova-compute[75097]:   </clock>
Nov 14 16:23:57 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:23:57 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:23:57 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:23:57 user nova-compute[75097]:   </cpu>
Nov 14 16:23:57 user nova-compute[75097]:   <devices>
Nov 14 16:23:57 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:23:57 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:23:57 user nova-compute[75097]:       <source dev="/dev/sde"/>
Nov 14 16:23:57 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:23:57 user nova-compute[75097]:       <serial>fa25e5b6-50cf-4b34-92d5-d2dcac9bf595</serial>
Nov 14 16:23:57 user nova-compute[75097]:     </disk>
Nov 14 16:23:57 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:23:57 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:23:57 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue"/>
Nov 14 16:23:57 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:23:57 user nova-compute[75097]:       <boot order="1"/>
Nov 14 16:23:57 user nova-compute[75097]:     </disk>
Nov 14 16:23:57 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:23:57 user nova-compute[75097]:       <mac address="fa:16:3e:46:c8:14"/>
Nov 14 16:23:57 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:23:57 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:23:57 user nova-compute[75097]:       <target dev="tap22af481a-a3"/>
Nov 14 16:23:57 user nova-compute[75097]:     </interface>
Nov 14 16:23:57 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:23:57 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/console.log" append="off"/>
Nov 14 16:23:57 user nova-compute[75097]:     </serial>
Nov 14 16:23:57 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:23:57 user nova-compute[75097]:     <video>
Nov 14 16:23:57 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:23:57 user nova-compute[75097]:     </video>
Nov 14 16:23:57 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:23:57 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:23:57 user nova-compute[75097]:     </rng>
Nov 14 16:23:57 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:23:57 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:23:57 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:23:57 user nova-compute[75097]:     </memballoon>
Nov 14 16:23:57 user nova-compute[75097]:   </devices>
Nov 14 16:23:57 user nova-compute[75097]: </domain>
Nov 14 16:23:57 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:23:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance destroyed successfully.
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:23:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] No VIF found with MAC fa:16:3e:46:c8:14, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-197e8ef7-71b2-4054-9013-39b489ea2e1f req-028dfa3b-e6d3-4001-99fa-111c39febc80 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-197e8ef7-71b2-4054-9013-39b489ea2e1f req-028dfa3b-e6d3-4001-99fa-111c39febc80 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-197e8ef7-71b2-4054-9013-39b489ea2e1f req-028dfa3b-e6d3-4001-99fa-111c39febc80 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-197e8ef7-71b2-4054-9013-39b489ea2e1f req-028dfa3b-e6d3-4001-99fa-111c39febc80 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG nova.compute.manager [req-197e8ef7-71b2-4054-9013-39b489ea2e1f req-028dfa3b-e6d3-4001-99fa-111c39febc80 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:23:58 user nova-compute[75097]: WARNING nova.compute.manager [req-197e8ef7-71b2-4054-9013-39b489ea2e1f req-028dfa3b-e6d3-4001-99fa-111c39febc80 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state active and task_state rescuing.
Nov 14 16:23:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:23:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8e958887-e962-45d7-aa81-9079b0bb238c tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-086782fb-f9d9-496d-b409-0d825da7f60b req-48a18fa7-2923-48c5-a2e8-4994fad3612c service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-086782fb-f9d9-496d-b409-0d825da7f60b req-48a18fa7-2923-48c5-a2e8-4994fad3612c service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-086782fb-f9d9-496d-b409-0d825da7f60b req-48a18fa7-2923-48c5-a2e8-4994fad3612c service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-086782fb-f9d9-496d-b409-0d825da7f60b req-48a18fa7-2923-48c5-a2e8-4994fad3612c service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-086782fb-f9d9-496d-b409-0d825da7f60b req-48a18fa7-2923-48c5-a2e8-4994fad3612c service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:24:00 user nova-compute[75097]: WARNING nova.compute.manager [req-086782fb-f9d9-496d-b409-0d825da7f60b req-48a18fa7-2923-48c5-a2e8-4994fad3612c service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state rescued and task_state None.
Nov 14 16:24:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:06 user nova-compute[75097]: INFO nova.compute.manager [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Detaching volume 49de22a7-a2b7-481b-929f-d1206136d383
Nov 14 16:24:07 user nova-compute[75097]: INFO nova.virt.block_device [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Attempting to driver detach volume 49de22a7-a2b7-481b-929f-d1206136d383 from mountpoint /dev/vdc
Nov 14 16:24:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Attempting to detach device vdc from instance ba5d73ac-e962-4121-80c1-4d48077851ab from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:24:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:24:07 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:24:07 user nova-compute[75097]:   <source dev="/dev/sdf"/>
Nov 14 16:24:07 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:24:07 user nova-compute[75097]:   <serial>49de22a7-a2b7-481b-929f-d1206136d383</serial>
Nov 14 16:24:07 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:24:07 user nova-compute[75097]: </disk>
Nov 14 16:24:07 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:24:07 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully detached device vdc from instance ba5d73ac-e962-4121-80c1-4d48077851ab from the persistent domain config.
Nov 14 16:24:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ba5d73ac-e962-4121-80c1-4d48077851ab from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:24:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:24:07 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:24:07 user nova-compute[75097]:   <source dev="/dev/sdf"/>
Nov 14 16:24:07 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:24:07 user nova-compute[75097]:   <serial>49de22a7-a2b7-481b-929f-d1206136d383</serial>
Nov 14 16:24:07 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:24:07 user nova-compute[75097]: </disk>
Nov 14 16:24:07 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:24:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:24:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:24:21 user nova-compute[75097]: INFO nova.compute.manager [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] instance snapshotting
Nov 14 16:24:21 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Beginning live snapshot process
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp646l95iw/110d607903894c029a7cbeb13e57a501.delta 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp646l95iw/110d607903894c029a7cbeb13e57a501.delta 1073741824" returned: 0 in 0.052s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 16:24:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:24:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] COPY block job progress, current cursor: 12058624 final cursor: 75563008 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:24:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:24:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 16:24:24 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:24:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp646l95iw/110d607903894c029a7cbeb13e57a501.delta /opt/stack/data/nova/instances/snapshots/tmp646l95iw/110d607903894c029a7cbeb13e57a501 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp646l95iw/110d607903894c029a7cbeb13e57a501.delta /opt/stack/data/nova/instances/snapshots/tmp646l95iw/110d607903894c029a7cbeb13e57a501" returned: 0 in 0.700s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Snapshot extracted, beginning image upload
Nov 14 16:24:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:27 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ba5d73ac-e962-4121-80c1-4d48077851ab is timed out.
Nov 14 16:24:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully detached device vdc from instance ba5d73ac-e962-4121-80c1-4d48077851ab from the live domain config.
Nov 14 16:24:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwGMfvIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:24:27 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098ea3d-2ce7-4485-bd2f-eb83b65c2a62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:24:27 user nova-compute[75097]: No targets found.
Nov 14 16:24:27 user nova-compute[75097]: iSNS:
Nov 14 16:24:27 user nova-compute[75097]: No targets found.
Nov 14 16:24:27 user nova-compute[75097]: STATIC:
Nov 14 16:24:27 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:24:27 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:24:27 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:24:27 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383
Nov 14 16:24:27 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:24:27 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:24:27 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:24:27 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:24:27 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:24:27 user nova-compute[75097]: FIRMWARE:
Nov 14 16:24:27 user nova-compute[75097]: No targets found.
Nov 14 16:24:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:24:27 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:24:27 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b3958-f3a2-4d58-aea3-bc079bb3925a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8383e0e-3db1-4043-b96c-f366c42945fe]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:24:27 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:24:27 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:24:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:24:27 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:24:27 user nova-compute[75097]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 (non-flash)
Nov 14 16:24:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98447640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383'): ({'sdf'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Removing single pathed devices sdf {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75355a7-23f1-4eb5-abe3-3860a3b96047]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[001cd7d3-c3ea-4974-8603-bc3bf50c3fe5]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flushing IO for device /dev/sdf {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31854e1-4537-4f50-a5af-7da454a74983]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f37fac-4e30-4ccd-92c2-dbb546aea976]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] SCSI volumes sdf have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[043e60a4-8096-4500-b617-aeb132513675]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Snapshot image upload complete
Nov 14 16:24:27 user nova-compute[75097]: INFO nova.compute.manager [None req-06526064-95ae-4624-9586-532e8ba41f41 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Took 5.79 seconds to snapshot the instance on the hypervisor.
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f4a051-b3b9-4304-b78c-6c941f279874]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260]
Nov 14 16:24:27 user nova-compute[75097]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383, portal: 172.16.0.220,3260] successful.
Nov 14 16:24:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49de22a7-a2b7-481b-929f-d1206136d383 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9121d0-c2a7-40ad-8a5c-e4bdf672f8f7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] <== disconnect_volume: return (299ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:24:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:24:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'flavor' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:24:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-582e415b-6c23-49bb-9bf6-578071014f79 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.938s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:24:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:24:29 user nova-compute[75097]: INFO nova.compute.claims [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Claim successful on node user
Nov 14 16:24:29 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:24:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.policy [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53827b8c6b514b68987dd448fbc17bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13dd81460e04ef0a3ef496334da5241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:24:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Creating image(s)
Nov 14 16:24:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "/opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "/opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "/opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "e7d9183320dfdf33dab303ccb7be71391dfd31d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "e7d9183320dfdf33dab303ccb7be71391dfd31d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG nova.virt.images [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] 276366ad-d6be-49fe-a180-58bb476ac18b was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.part /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Successfully created port: 109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.part /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.converted" returned: 0 in 0.590s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "e7d9183320dfdf33dab303ccb7be71391dfd31d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.801s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Successfully updated port: 109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4 --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "e7d9183320dfdf33dab303ccb7be71391dfd31d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "e7d9183320dfdf33dab303ccb7be71391dfd31d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquired lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-changed-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Refreshing instance network info cache due to event network-changed-109ae602-6791-496c-8654-b5310a341a0f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] Acquiring lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4 --force-share --output=json" returned: 0 in 0.164s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4,backing_fmt=raw /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4,backing_fmt=raw /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk 1073741824" returned: 0 in 0.047s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "e7d9183320dfdf33dab303ccb7be71391dfd31d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4 --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4 --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Ensure instance console log exists: /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.neutron [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updating instance_info_cache with network_info: [{"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Releasing lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Instance network_info: |[{"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] Acquired lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Refreshing network info cache for port 109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Start _get_guest_xml network_info=[{"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e4c33096928439e20719487aa1e756bd',container_format='bare',created_at=2023-11-14T16:24:22Z,direct_url=<?>,disk_format='qcow2',id=276366ad-d6be-49fe-a180-58bb476ac18b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1761270972',owner='e13dd81460e04ef0a3ef496334da5241',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T16:24:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '276366ad-d6be-49fe-a180-58bb476ac18b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:24:32 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:24:32 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e4c33096928439e20719487aa1e756bd',container_format='bare',created_at=2023-11-14T16:24:22Z,direct_url=<?>,disk_format='qcow2',id=276366ad-d6be-49fe-a180-58bb476ac18b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1761270972',owner='e13dd81460e04ef0a3ef496334da5241',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T16:24:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-930698619',display_name='tempest-TestStampPattern-server-930698619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-930698619',id=38,image_ref='276366ad-d6be-49fe-a180-58bb476ac18b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbs2YwP80IOgHAD4NMnt5vdrmpl7fZEhV1O1GdfggXQ4hLf7fZp3jF2/qIPcowDLKmtwQQ+3ReVQ1RBSOK4/wv8tfl5WIvkE/weu2QpYUM+/xPDHk3JFkaKTleUxqTr3Q==',key_name='tempest-TestStampPattern-1197072316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dd81460e04ef0a3ef496334da5241',ramdisk_id='',reservation_id='r-30gfnwag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a77934ca-8e15-4158-9d25-cd20427d5b07',image_min_disk='1',image_min_ram='0',image_owner_id='e13dd81460e04ef0a3ef496334da5241',image_owner_project_name='tempest-TestStampPattern-1146793101',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1146793101-project-member',image_user_id='53827b8c6b514b68987dd448fbc17bcd',network_allocated='True',owner_project_name='tempest-TestStampPattern-1146793101',owner_user_name='tempest-TestStampPattern-1146793101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:24:30Z,user_data=None,user_id='53827b8c6b514b68987dd448fbc17bcd',uuid=281221f9-f7e4-4841-97a0-6dbfcf658a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converting VIF {"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'pci_devices' on Instance uuid 281221f9-f7e4-4841-97a0-6dbfcf658a20 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:24:32 user nova-compute[75097]:   <uuid>281221f9-f7e4-4841-97a0-6dbfcf658a20</uuid>
Nov 14 16:24:32 user nova-compute[75097]:   <name>instance-00000026</name>
Nov 14 16:24:32 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:24:32 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:24:32 user nova-compute[75097]:   <metadata>
Nov 14 16:24:32 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:24:32 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:24:32 user nova-compute[75097]:       <nova:name>tempest-TestStampPattern-server-930698619</nova:name>
Nov 14 16:24:32 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:24:32</nova:creationTime>
Nov 14 16:24:32 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:24:32 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:24:32 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:24:32 user nova-compute[75097]:       <nova:owner>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:user uuid="53827b8c6b514b68987dd448fbc17bcd">tempest-TestStampPattern-1146793101-project-member</nova:user>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:project uuid="e13dd81460e04ef0a3ef496334da5241">tempest-TestStampPattern-1146793101</nova:project>
Nov 14 16:24:32 user nova-compute[75097]:       </nova:owner>
Nov 14 16:24:32 user nova-compute[75097]:       <nova:root type="image" uuid="276366ad-d6be-49fe-a180-58bb476ac18b"/>
Nov 14 16:24:32 user nova-compute[75097]:       <nova:ports>
Nov 14 16:24:32 user nova-compute[75097]:         <nova:port uuid="109ae602-6791-496c-8654-b5310a341a0f">
Nov 14 16:24:32 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 16:24:32 user nova-compute[75097]:         </nova:port>
Nov 14 16:24:32 user nova-compute[75097]:       </nova:ports>
Nov 14 16:24:32 user nova-compute[75097]:     </nova:instance>
Nov 14 16:24:32 user nova-compute[75097]:   </metadata>
Nov 14 16:24:32 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:24:32 user nova-compute[75097]:     <system>
Nov 14 16:24:32 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:24:32 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:24:32 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:24:32 user nova-compute[75097]:       <entry name="serial">281221f9-f7e4-4841-97a0-6dbfcf658a20</entry>
Nov 14 16:24:32 user nova-compute[75097]:       <entry name="uuid">281221f9-f7e4-4841-97a0-6dbfcf658a20</entry>
Nov 14 16:24:32 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:24:32 user nova-compute[75097]:     </system>
Nov 14 16:24:32 user nova-compute[75097]:   </sysinfo>
Nov 14 16:24:32 user nova-compute[75097]:   <os>
Nov 14 16:24:32 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:24:32 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:24:32 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:24:32 user nova-compute[75097]:   </os>
Nov 14 16:24:32 user nova-compute[75097]:   <features>
Nov 14 16:24:32 user nova-compute[75097]:     <acpi/>
Nov 14 16:24:32 user nova-compute[75097]:     <apic/>
Nov 14 16:24:32 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:24:32 user nova-compute[75097]:   </features>
Nov 14 16:24:32 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:24:32 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:24:32 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:24:32 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:24:32 user nova-compute[75097]:   </clock>
Nov 14 16:24:32 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:24:32 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:24:32 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:24:32 user nova-compute[75097]:   </cpu>
Nov 14 16:24:32 user nova-compute[75097]:   <devices>
Nov 14 16:24:32 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:24:32 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:24:32 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk"/>
Nov 14 16:24:32 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:24:32 user nova-compute[75097]:     </disk>
Nov 14 16:24:32 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:24:32 user nova-compute[75097]:       <mac address="fa:16:3e:2a:f7:a8"/>
Nov 14 16:24:32 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:24:32 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:24:32 user nova-compute[75097]:       <target dev="tap109ae602-67"/>
Nov 14 16:24:32 user nova-compute[75097]:     </interface>
Nov 14 16:24:32 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:24:32 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/console.log" append="off"/>
Nov 14 16:24:32 user nova-compute[75097]:     </serial>
Nov 14 16:24:32 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:24:32 user nova-compute[75097]:     <video>
Nov 14 16:24:32 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:24:32 user nova-compute[75097]:     </video>
Nov 14 16:24:32 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:24:32 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:24:32 user nova-compute[75097]:     </rng>
Nov 14 16:24:32 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:24:32 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:24:32 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:24:32 user nova-compute[75097]:     </memballoon>
Nov 14 16:24:32 user nova-compute[75097]:   </devices>
Nov 14 16:24:32 user nova-compute[75097]: </domain>
Nov 14 16:24:32 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-930698619',display_name='tempest-TestStampPattern-server-930698619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-930698619',id=38,image_ref='276366ad-d6be-49fe-a180-58bb476ac18b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbs2YwP80IOgHAD4NMnt5vdrmpl7fZEhV1O1GdfggXQ4hLf7fZp3jF2/qIPcowDLKmtwQQ+3ReVQ1RBSOK4/wv8tfl5WIvkE/weu2QpYUM+/xPDHk3JFkaKTleUxqTr3Q==',key_name='tempest-TestStampPattern-1197072316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13dd81460e04ef0a3ef496334da5241',ramdisk_id='',reservation_id='r-30gfnwag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a77934ca-8e15-4158-9d25-cd20427d5b07',image_min_disk='1',image_min_ram='0',image_owner_id='e13dd81460e04ef0a3ef496334da5241',image_owner_project_name='tempest-TestStampPattern-1146793101',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1146793101-project-member',image_user_id='53827b8c6b514b68987dd448fbc17bcd',network_allocated='True',owner_project_name='tempest-TestStampPattern-1146793101',owner_user_name='tempest-TestStampPattern-1146793101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:24:30Z,user_data=None,user_id='53827b8c6b514b68987dd448fbc17bcd',uuid=281221f9-f7e4-4841-97a0-6dbfcf658a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converting VIF {"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG os_vif [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c60240ce-d2d0-5b81-b097-7a0a2d9ed875', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap109ae602-67, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap109ae602-67, col_values=(('qos', UUID('e9331986-184b-49c9-849d-9b9866fd1099')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap109ae602-67, col_values=(('external_ids', {'iface-id': '109ae602-6791-496c-8654-b5310a341a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:f7:a8', 'vm-uuid': '281221f9-f7e4-4841-97a0-6dbfcf658a20'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:32 user nova-compute[75097]: INFO os_vif [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67')
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:24:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No VIF found with MAC fa:16:3e:2a:f7:a8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:24:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updated VIF entry in instance network info cache for port 109ae602-6791-496c-8654-b5310a341a0f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:24:33 user nova-compute[75097]: DEBUG nova.network.neutron [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updating instance_info_cache with network_info: [{"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:24:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4539db47-28cc-4af5-9768-bc0ca069cce6 req-3ece73bf-67b8-4cad-9b20-b07d4742ee1d service nova] Releasing lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-bfc5653f-f026-4ef6-ae23-d765327ae087 req-5141cdee-b211-432e-9871-fd1734b13f00 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bfc5653f-f026-4ef6-ae23-d765327ae087 req-5141cdee-b211-432e-9871-fd1734b13f00 service nova] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bfc5653f-f026-4ef6-ae23-d765327ae087 req-5141cdee-b211-432e-9871-fd1734b13f00 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bfc5653f-f026-4ef6-ae23-d765327ae087 req-5141cdee-b211-432e-9871-fd1734b13f00 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-bfc5653f-f026-4ef6-ae23-d765327ae087 req-5141cdee-b211-432e-9871-fd1734b13f00 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] No waiting events found dispatching network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:24:34 user nova-compute[75097]: WARNING nova.compute.manager [req-bfc5653f-f026-4ef6-ae23-d765327ae087 req-5141cdee-b211-432e-9871-fd1734b13f00 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received unexpected event network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f for instance with vm_state building and task_state spawning.
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:24:36 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Instance spawned successfully.
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:24:36 user nova-compute[75097]: INFO nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:24:36 user nova-compute[75097]: INFO nova.compute.manager [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Took 6.65 seconds to build instance.
Nov 14 16:24:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b23001f-553e-433b-af3a-c1f1aafa6d1c tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-071259f5-84af-4cd2-a10e-9e875a549f6f req-e8610d83-1a00-402f-b61c-f45ebb2c5be3 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-071259f5-84af-4cd2-a10e-9e875a549f6f req-e8610d83-1a00-402f-b61c-f45ebb2c5be3 service nova] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-071259f5-84af-4cd2-a10e-9e875a549f6f req-e8610d83-1a00-402f-b61c-f45ebb2c5be3 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-071259f5-84af-4cd2-a10e-9e875a549f6f req-e8610d83-1a00-402f-b61c-f45ebb2c5be3 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-071259f5-84af-4cd2-a10e-9e875a549f6f req-e8610d83-1a00-402f-b61c-f45ebb2c5be3 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] No waiting events found dispatching network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:24:36 user nova-compute[75097]: WARNING nova.compute.manager [req-071259f5-84af-4cd2-a10e-9e875a549f6f req-e8610d83-1a00-402f-b61c-f45ebb2c5be3 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received unexpected event network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f for instance with vm_state active and task_state None.
Nov 14 16:24:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "be1d215e-2281-4863-9df2-9ca20589bba3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:38 user nova-compute[75097]: INFO nova.compute.manager [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Terminating instance
Nov 14 16:24:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-86651299-6276-4aab-b653-d2797a732e1e req-89b12544-41fa-4078-9595-1d16280326e7 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-vif-unplugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-86651299-6276-4aab-b653-d2797a732e1e req-89b12544-41fa-4078-9595-1d16280326e7 service nova] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-86651299-6276-4aab-b653-d2797a732e1e req-89b12544-41fa-4078-9595-1d16280326e7 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-86651299-6276-4aab-b653-d2797a732e1e req-89b12544-41fa-4078-9595-1d16280326e7 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-86651299-6276-4aab-b653-d2797a732e1e req-89b12544-41fa-4078-9595-1d16280326e7 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] No waiting events found dispatching network-vif-unplugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-86651299-6276-4aab-b653-d2797a732e1e req-89b12544-41fa-4078-9595-1d16280326e7 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-vif-unplugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:24:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Instance destroyed successfully.
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.objects.instance [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lazy-loading 'resources' on Instance uuid be1d215e-2281-4863-9df2-9ca20589bba3 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-976217407',display_name='tempest-VolumesActionsTest-instance-976217407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-976217407',id=37,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1049d85cb459183193d23a3cb60d3',ramdisk_id='',reservation_id='r-pklyi10z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1541833219',owner_user_name='tempest-VolumesActionsTest-1541833219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:22:54Z,user_data=None,user_id='2759dad7d2ed4ab998b1bb2a50269d6c',uuid=be1d215e-2281-4863-9df2-9ca20589bba3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converting VIF {"id": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "address": "fa:16:3e:8a:ab:b9", "network": {"id": "4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-148565737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1049d85cb459183193d23a3cb60d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap873dd03b-62", "ovs_interfaceid": "873dd03b-6295-4400-95c7-1e0dc4a0ba42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG os_vif [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap873dd03b-62, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2da66119-4723-4a8a-ba81-5c44ea39a718) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:39 user nova-compute[75097]: INFO os_vif [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:b9,bridge_name='br-int',has_traffic_filtering=True,id=873dd03b-6295-4400-95c7-1e0dc4a0ba42,network=Network(4466e965-d4ec-4dea-b3d3-8fd7e1de1cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap873dd03b-62')
Nov 14 16:24:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Deleting instance files /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3_del
Nov 14 16:24:39 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Deletion of /opt/stack/data/nova/instances/be1d215e-2281-4863-9df2-9ca20589bba3_del complete
Nov 14 16:24:39 user nova-compute[75097]: INFO nova.compute.manager [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 16:24:39 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:24:39 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:24:40 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:24:40 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Took 0.48 seconds to deallocate network for instance.
Nov 14 16:24:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:40 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:24:40 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:24:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:40 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Deleted allocations for instance be1d215e-2281-4863-9df2-9ca20589bba3
Nov 14 16:24:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-054b6550-feb5-433d-86df-6261c39b0b39 tempest-VolumesActionsTest-1541833219 tempest-VolumesActionsTest-1541833219-project-member] Lock "be1d215e-2281-4863-9df2-9ca20589bba3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] Acquiring lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] Lock "be1d215e-2281-4863-9df2-9ca20589bba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] No waiting events found dispatching network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:24:41 user nova-compute[75097]: WARNING nova.compute.manager [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received unexpected event network-vif-plugged-873dd03b-6295-4400-95c7-1e0dc4a0ba42 for instance with vm_state deleted and task_state None.
Nov 14 16:24:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-fbcccb74-a580-4cf0-8794-a15eb12989e4 req-0f6e16f0-5b9a-437c-8fc8-04823b3f44f2 service nova] [instance: be1d215e-2281-4863-9df2-9ca20589bba3] Received event network-vif-deleted-873dd03b-6295-4400-95c7-1e0dc4a0ba42 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:24:53 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:24:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:24:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:57 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:24:57 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8255MB free_disk=24.768028259277344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94ce8238-e007-426f-9ad9-5d9a79ced856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance ba5d73ac-e962-4121-80c1-4d48077851ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:57 user nova-compute[75097]: INFO nova.compute.manager [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Terminating instance
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:58 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Instance destroyed successfully.
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'resources' on Instance uuid ba5d73ac-e962-4121-80c1-4d48077851ab {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1026740153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1026740153',id=31,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaJkJneQF8jADu23T7xukX6Erw1pMtRbIZCg7OEWsueJmWMzA9BASjxEjDDdgfVmTW4dgloXHpY97nUgQr619DW50mqIGnxGd42NZ34QRB6CV4B9aBclkM4t/xIgYEdEA==',key_name='tempest-keypair-1809749550',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-r2hzputd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:22:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=ba5d73ac-e962-4121-80c1-4d48077851ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "abc26054-33f4-4cd1-8038-2d0737b45add", "address": "fa:16:3e:39:10:31", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc26054-33", "ovs_interfaceid": "abc26054-33f4-4cd1-8038-2d0737b45add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG os_vif [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabc26054-33, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3683433c-a2db-4be3-95fc-cb3ad754c6ee) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:24:58 user nova-compute[75097]: INFO os_vif [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:10:31,bridge_name='br-int',has_traffic_filtering=True,id=abc26054-33f4-4cd1-8038-2d0737b45add,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc26054-33')
Nov 14 16:24:58 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Deleting instance files /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab_del
Nov 14 16:24:58 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Deletion of /opt/stack/data/nova/instances/ba5d73ac-e962-4121-80c1-4d48077851ab_del complete
Nov 14 16:24:58 user nova-compute[75097]: INFO nova.compute.manager [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 16:24:58 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:58 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:24:59 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Took 1.27 seconds to deallocate network for instance.
Nov 14 16:24:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-2ab79425-c290-4572-8b12-2e6cb316fbd9 req-97f61f38-0720-4b57-ac9e-10a68371c16b service nova] [instance: ba5d73ac-e962-4121-80c1-4d48077851ab] Received event network-vif-deleted-abc26054-33f4-4cd1-8038-2d0737b45add {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:24:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:24:59 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Deleted allocations for instance ba5d73ac-e962-4121-80c1-4d48077851ab
Nov 14 16:24:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6e16afc2-9fd0-4a61-841d-87e92d20ceb7 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "ba5d73ac-e962-4121-80c1-4d48077851ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:25:12 user nova-compute[75097]: INFO nova.compute.claims [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Claim successful on node user
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:25:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:25:12 user nova-compute[75097]: DEBUG nova.policy [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc348d16cb0415fbbb357b7f030798e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea103d756c514917ae4aeb70b70b9097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:25:12 user nova-compute[75097]: INFO nova.virt.block_device [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Booting with volume snapshot 6b1205fd-c41e-4b7c-82c2-0b102175b581 at /dev/vda
Nov 14 16:25:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:13 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Successfully created port: fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Successfully updated port: fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "refresh_cache-054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquired lock "refresh_cache-054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-changed-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Refreshing instance network info cache due to event network-changed-fb037b73-61e8-4de7-b3b1-d28ec882ecbf. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] Acquiring lock "refresh_cache-054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Updating instance_info_cache with network_info: [{"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Releasing lock "refresh_cache-054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Instance network_info: |[{"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] Acquired lock "refresh_cache-054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Refreshing network info cache for port fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Updated VIF entry in instance network info cache for port fb037b73-61e8-4de7-b3b1-d28ec882ecbf. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Updating instance_info_cache with network_info: [{"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:25:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-36359740-12e8-4210-8d68-37b34092e368 req-7434551c-c151-433b-b311-b083f8013eb1 service nova] Releasing lock "refresh_cache-054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:25:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG os_brick.utils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7b3685-9554-4150-b6b4-df0e07dd0ec9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ab6ca-221f-4975-96b9-d39aecaf6cfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b0960f-6d07-42bc-a8fe-c2ca31bd4dc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a168a-f4bd-4a20-a9f4-6d306a165815]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:25:18 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:25:18 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed8767d-6d81-421d-a864-b7356a182cfd]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG os_brick.utils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:25:18 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Updating existing volume attachment record: 69ce6a4e-1142-4c9a-824f-ce62da973ff9 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:25:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:25:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Creating image(s)
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Ensure instance console log exists: /opt/stack/data/nova/instances/054897d6-c6f2-4d69-a9ad-a3d9e70cafdc/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Start _get_guest_xml network_info=[{"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pajRSOTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '054897d6-c6f2-4d69-a9ad-a3d9e70cafdc', 'attached_at': '', 'detached_at': '', 'volume_id': '00fbfcf4-51db-4552-8665-ac0056c67bb3', 'serial': '00fbfcf4-51db-4552-8665-ac0056c67bb3'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '69ce6a4e-1142-4c9a-824f-ce62da973ff9', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:25:22 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:25:22 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pajRSOTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:25:22 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:25:22 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:25:22 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec75743-7190-481f-951e-d0e822210fc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:25:22 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8447d6f3-4894-4c87-bb8a-3da21aa8e551]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3] added
Nov 14 16:25:22 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beafee1-8c58-4f82-b704-5af1e8eb6d8c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9059b38-1475-41c5-9e47-277c690b2e7d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pajRSOTN {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pajRSOTN" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348f4fc-7e9c-4f78-ab76-240baf61825d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pajRSOTN'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c8b4e-c128-46e1-8cd1-c2559c4fc654]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4947e2-8cd1-48a2-8b44-319f19ecee15]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c234b-b7b0-4bec-bd08-894214e1a7f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260]
Nov 14 16:25:23 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260] successful.
Nov 14 16:25:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.060s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68d5e1d-b059-47a8-ad67-9a40fe1f9b7b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[40218e2d-2273-4156-ab8a-9e5707e80f80]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:25:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaad4dd-9c90-4030-93b6-0124299a6672]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:25:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pajRSOTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23663623233343162', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663623233343162', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:25:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1023027050',display_name='tempest-TestVolumeBootPattern-server-1023027050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1023027050',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-vy7c2mv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:25:13Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=054897d6-c6f2-4d69-a9ad-a3d9e70cafdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'pci_devices' on Instance uuid 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:25:24 user nova-compute[75097]:   <uuid>054897d6-c6f2-4d69-a9ad-a3d9e70cafdc</uuid>
Nov 14 16:25:24 user nova-compute[75097]:   <name>instance-00000027</name>
Nov 14 16:25:24 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:25:24 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:25:24 user nova-compute[75097]:   <metadata>
Nov 14 16:25:24 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:25:24 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:25:24 user nova-compute[75097]:       <nova:name>tempest-TestVolumeBootPattern-server-1023027050</nova:name>
Nov 14 16:25:24 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:25:22</nova:creationTime>
Nov 14 16:25:24 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:25:24 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:25:24 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:25:24 user nova-compute[75097]:       <nova:owner>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:user uuid="7dc348d16cb0415fbbb357b7f030798e">tempest-TestVolumeBootPattern-1353533810-project-member</nova:user>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:project uuid="ea103d756c514917ae4aeb70b70b9097">tempest-TestVolumeBootPattern-1353533810</nova:project>
Nov 14 16:25:24 user nova-compute[75097]:       </nova:owner>
Nov 14 16:25:24 user nova-compute[75097]:       <nova:ports>
Nov 14 16:25:24 user nova-compute[75097]:         <nova:port uuid="fb037b73-61e8-4de7-b3b1-d28ec882ecbf">
Nov 14 16:25:24 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 16:25:24 user nova-compute[75097]:         </nova:port>
Nov 14 16:25:24 user nova-compute[75097]:       </nova:ports>
Nov 14 16:25:24 user nova-compute[75097]:     </nova:instance>
Nov 14 16:25:24 user nova-compute[75097]:   </metadata>
Nov 14 16:25:24 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:25:24 user nova-compute[75097]:     <system>
Nov 14 16:25:24 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:25:24 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:25:24 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:25:24 user nova-compute[75097]:       <entry name="serial">054897d6-c6f2-4d69-a9ad-a3d9e70cafdc</entry>
Nov 14 16:25:24 user nova-compute[75097]:       <entry name="uuid">054897d6-c6f2-4d69-a9ad-a3d9e70cafdc</entry>
Nov 14 16:25:24 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:25:24 user nova-compute[75097]:     </system>
Nov 14 16:25:24 user nova-compute[75097]:   </sysinfo>
Nov 14 16:25:24 user nova-compute[75097]:   <os>
Nov 14 16:25:24 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:25:24 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:25:24 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:25:24 user nova-compute[75097]:   </os>
Nov 14 16:25:24 user nova-compute[75097]:   <features>
Nov 14 16:25:24 user nova-compute[75097]:     <acpi/>
Nov 14 16:25:24 user nova-compute[75097]:     <apic/>
Nov 14 16:25:24 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:25:24 user nova-compute[75097]:   </features>
Nov 14 16:25:24 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:25:24 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:25:24 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:25:24 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:25:24 user nova-compute[75097]:   </clock>
Nov 14 16:25:24 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:25:24 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:25:24 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:25:24 user nova-compute[75097]:   </cpu>
Nov 14 16:25:24 user nova-compute[75097]:   <devices>
Nov 14 16:25:24 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:25:24 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:25:24 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:25:24 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:25:24 user nova-compute[75097]:       <serial>00fbfcf4-51db-4552-8665-ac0056c67bb3</serial>
Nov 14 16:25:24 user nova-compute[75097]:     </disk>
Nov 14 16:25:24 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:25:24 user nova-compute[75097]:       <mac address="fa:16:3e:7d:b1:2c"/>
Nov 14 16:25:24 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:25:24 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:25:24 user nova-compute[75097]:       <target dev="tapfb037b73-61"/>
Nov 14 16:25:24 user nova-compute[75097]:     </interface>
Nov 14 16:25:24 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:25:24 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/054897d6-c6f2-4d69-a9ad-a3d9e70cafdc/console.log" append="off"/>
Nov 14 16:25:24 user nova-compute[75097]:     </serial>
Nov 14 16:25:24 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:25:24 user nova-compute[75097]:     <video>
Nov 14 16:25:24 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:25:24 user nova-compute[75097]:     </video>
Nov 14 16:25:24 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:25:24 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:25:24 user nova-compute[75097]:     </rng>
Nov 14 16:25:24 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:25:24 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:25:24 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:25:24 user nova-compute[75097]:     </memballoon>
Nov 14 16:25:24 user nova-compute[75097]:   </devices>
Nov 14 16:25:24 user nova-compute[75097]: </domain>
Nov 14 16:25:24 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:25:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1023027050',display_name='tempest-TestVolumeBootPattern-server-1023027050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1023027050',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-vy7c2mv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:25:13Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=054897d6-c6f2-4d69-a9ad-a3d9e70cafdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG os_vif [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6fd5ae6-0411-5b4d-b518-55216bc58620', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb037b73-61, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb037b73-61, col_values=(('qos', UUID('2a6e52f8-d9f8-4ae0-b18f-7c402d222f6f')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb037b73-61, col_values=(('external_ids', {'iface-id': 'fb037b73-61e8-4de7-b3b1-d28ec882ecbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:b1:2c', 'vm-uuid': '054897d6-c6f2-4d69-a9ad-a3d9e70cafdc'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:24 user nova-compute[75097]: INFO os_vif [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61')
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:25:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No VIF found with MAC fa:16:3e:7d:b1:2c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-5daf3d5a-5cb3-42c9-9e8f-8454ea3f428c req-d20ea7ae-bb6f-412e-987d-a3edbcb558ea service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5daf3d5a-5cb3-42c9-9e8f-8454ea3f428c req-d20ea7ae-bb6f-412e-987d-a3edbcb558ea service nova] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5daf3d5a-5cb3-42c9-9e8f-8454ea3f428c req-d20ea7ae-bb6f-412e-987d-a3edbcb558ea service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5daf3d5a-5cb3-42c9-9e8f-8454ea3f428c req-d20ea7ae-bb6f-412e-987d-a3edbcb558ea service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-5daf3d5a-5cb3-42c9-9e8f-8454ea3f428c req-d20ea7ae-bb6f-412e-987d-a3edbcb558ea service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] No waiting events found dispatching network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:25 user nova-compute[75097]: WARNING nova.compute.manager [req-5daf3d5a-5cb3-42c9-9e8f-8454ea3f428c req-d20ea7ae-bb6f-412e-987d-a3edbcb558ea service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received unexpected event network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf for instance with vm_state building and task_state spawning.
Nov 14 16:25:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:25:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Instance spawned successfully.
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:25:27 user nova-compute[75097]: INFO nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-115f33d5-7dbe-47bb-abe5-0e282853b23b req-74b9878c-790f-4822-a943-776a82d9a0ac service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-115f33d5-7dbe-47bb-abe5-0e282853b23b req-74b9878c-790f-4822-a943-776a82d9a0ac service nova] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-115f33d5-7dbe-47bb-abe5-0e282853b23b req-74b9878c-790f-4822-a943-776a82d9a0ac service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-115f33d5-7dbe-47bb-abe5-0e282853b23b req-74b9878c-790f-4822-a943-776a82d9a0ac service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-115f33d5-7dbe-47bb-abe5-0e282853b23b req-74b9878c-790f-4822-a943-776a82d9a0ac service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] No waiting events found dispatching network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:27 user nova-compute[75097]: WARNING nova.compute.manager [req-115f33d5-7dbe-47bb-abe5-0e282853b23b req-74b9878c-790f-4822-a943-776a82d9a0ac service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received unexpected event network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf for instance with vm_state building and task_state spawning.
Nov 14 16:25:27 user nova-compute[75097]: INFO nova.compute.manager [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Took 15.74 seconds to build instance.
Nov 14 16:25:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5ea99e01-fc54-458e-a3e4-84ee1b5abfaf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.830s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:43 user nova-compute[75097]: INFO nova.compute.manager [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Unrescuing
Nov 14 16:25:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:25:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquired lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:25:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updating instance_info_cache with network_info: [{"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Releasing lock "refresh_cache-94ce8238-e007-426f-9ad9-5d9a79ced856" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'flavor' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b1078b9-902f-4901-88e5-cbe76397aa53 req-84c3bb6f-6a60-4ee7-b08a-bb5ef3096fa2 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b1078b9-902f-4901-88e5-cbe76397aa53 req-84c3bb6f-6a60-4ee7-b08a-bb5ef3096fa2 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b1078b9-902f-4901-88e5-cbe76397aa53 req-84c3bb6f-6a60-4ee7-b08a-bb5ef3096fa2 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0b1078b9-902f-4901-88e5-cbe76397aa53 req-84c3bb6f-6a60-4ee7-b08a-bb5ef3096fa2 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-0b1078b9-902f-4901-88e5-cbe76397aa53 req-84c3bb6f-6a60-4ee7-b08a-bb5ef3096fa2 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:44 user nova-compute[75097]: WARNING nova.compute.manager [req-0b1078b9-902f-4901-88e5-cbe76397aa53 req-84c3bb6f-6a60-4ee7-b08a-bb5ef3096fa2 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:25:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance destroyed successfully.
Nov 14 16:25:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:46 user nova-compute[75097]: WARNING nova.compute.manager [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:25:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:46 user nova-compute[75097]: WARNING nova.compute.manager [req-81684574-4d65-4782-9256-c4bda1ee1ae1 req-db560b5b-5285-41e8-a701-b092e80a0a83 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:25:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-caf50997-2f12-424d-a21a-b04701f70990 req-c35fcd9b-3c16-4fd7-940d-ad1b8ed1f7d7 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-caf50997-2f12-424d-a21a-b04701f70990 req-c35fcd9b-3c16-4fd7-940d-ad1b8ed1f7d7 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-caf50997-2f12-424d-a21a-b04701f70990 req-c35fcd9b-3c16-4fd7-940d-ad1b8ed1f7d7 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-caf50997-2f12-424d-a21a-b04701f70990 req-c35fcd9b-3c16-4fd7-940d-ad1b8ed1f7d7 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-caf50997-2f12-424d-a21a-b04701f70990 req-c35fcd9b-3c16-4fd7-940d-ad1b8ed1f7d7 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:48 user nova-compute[75097]: WARNING nova.compute.manager [req-caf50997-2f12-424d-a21a-b04701f70990 req-c35fcd9b-3c16-4fd7-940d-ad1b8ed1f7d7 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:25:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:50 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2c34da60-ff48-42b7-848c-0834086e1e24 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:25:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:53 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [{"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-f8d51b37-5f88-45f1-876b-99e387812c3c" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:25:54 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:25:55 user nova-compute[75097]: INFO nova.compute.claims [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Claim successful on node user
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:25:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.policy [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eff36d66033f4331aa582c9fd2eab626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b644535e1a5b431e830a9d0aa10294e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:25:56 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Creating image(s)
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk 1073741824" returned: 0 in 0.047s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:25:56 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Successfully created port: 38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.497s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:25:57 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:25:57 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=23.792617797851562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94ce8238-e007-426f-9ad9-5d9a79ced856 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Successfully updated port: 38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Cannot resize image /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Ensure instance console log exists: /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-changed-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.manager [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing instance network info cache due to event network-changed-38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance network_info: |[{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.network.neutron [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Start _get_guest_xml network_info=[{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:25:57 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:25:57 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:25:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1794728049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1794728049',id=40,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWjMB38v0CHSDkExGfizMV0zkx+nG7JjphfeFbyPPwZ3oQOHA2qZimou3chjEHK5krBIFzvwqphV02HiERggD6J2WzHMOHBYLcjbGGeRGMlGQybngEsKFUOLhfrWuoYBg==',key_name='tempest-keypair-1203540656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-s23mde0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=8cf8cc4f-96f4-487a-8739-1fbedfd2d428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:25:58 user nova-compute[75097]:   <uuid>8cf8cc4f-96f4-487a-8739-1fbedfd2d428</uuid>
Nov 14 16:25:58 user nova-compute[75097]:   <name>instance-00000028</name>
Nov 14 16:25:58 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:25:58 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:25:58 user nova-compute[75097]:   <metadata>
Nov 14 16:25:58 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:25:58 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:25:58 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1794728049</nova:name>
Nov 14 16:25:58 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:25:57</nova:creationTime>
Nov 14 16:25:58 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:25:58 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:25:58 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:25:58 user nova-compute[75097]:       <nova:owner>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:user uuid="eff36d66033f4331aa582c9fd2eab626">tempest-AttachVolumeShelveTestJSON-347532404-project-member</nova:user>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:project uuid="b644535e1a5b431e830a9d0aa10294e3">tempest-AttachVolumeShelveTestJSON-347532404</nova:project>
Nov 14 16:25:58 user nova-compute[75097]:       </nova:owner>
Nov 14 16:25:58 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:25:58 user nova-compute[75097]:       <nova:ports>
Nov 14 16:25:58 user nova-compute[75097]:         <nova:port uuid="38115c8f-855f-478e-9ca6-5066d79321af">
Nov 14 16:25:58 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 16:25:58 user nova-compute[75097]:         </nova:port>
Nov 14 16:25:58 user nova-compute[75097]:       </nova:ports>
Nov 14 16:25:58 user nova-compute[75097]:     </nova:instance>
Nov 14 16:25:58 user nova-compute[75097]:   </metadata>
Nov 14 16:25:58 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:25:58 user nova-compute[75097]:     <system>
Nov 14 16:25:58 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:25:58 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:25:58 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:25:58 user nova-compute[75097]:       <entry name="serial">8cf8cc4f-96f4-487a-8739-1fbedfd2d428</entry>
Nov 14 16:25:58 user nova-compute[75097]:       <entry name="uuid">8cf8cc4f-96f4-487a-8739-1fbedfd2d428</entry>
Nov 14 16:25:58 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:25:58 user nova-compute[75097]:     </system>
Nov 14 16:25:58 user nova-compute[75097]:   </sysinfo>
Nov 14 16:25:58 user nova-compute[75097]:   <os>
Nov 14 16:25:58 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:25:58 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:25:58 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:25:58 user nova-compute[75097]:   </os>
Nov 14 16:25:58 user nova-compute[75097]:   <features>
Nov 14 16:25:58 user nova-compute[75097]:     <acpi/>
Nov 14 16:25:58 user nova-compute[75097]:     <apic/>
Nov 14 16:25:58 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:25:58 user nova-compute[75097]:   </features>
Nov 14 16:25:58 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:25:58 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:25:58 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:25:58 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:25:58 user nova-compute[75097]:   </clock>
Nov 14 16:25:58 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:25:58 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:25:58 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:25:58 user nova-compute[75097]:   </cpu>
Nov 14 16:25:58 user nova-compute[75097]:   <devices>
Nov 14 16:25:58 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:25:58 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:25:58 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk"/>
Nov 14 16:25:58 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:25:58 user nova-compute[75097]:     </disk>
Nov 14 16:25:58 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:25:58 user nova-compute[75097]:       <mac address="fa:16:3e:83:c3:b7"/>
Nov 14 16:25:58 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:25:58 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:25:58 user nova-compute[75097]:       <target dev="tap38115c8f-85"/>
Nov 14 16:25:58 user nova-compute[75097]:     </interface>
Nov 14 16:25:58 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:25:58 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/console.log" append="off"/>
Nov 14 16:25:58 user nova-compute[75097]:     </serial>
Nov 14 16:25:58 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:25:58 user nova-compute[75097]:     <video>
Nov 14 16:25:58 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:25:58 user nova-compute[75097]:     </video>
Nov 14 16:25:58 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:25:58 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:25:58 user nova-compute[75097]:     </rng>
Nov 14 16:25:58 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:25:58 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:25:58 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:25:58 user nova-compute[75097]:     </memballoon>
Nov 14 16:25:58 user nova-compute[75097]:   </devices>
Nov 14 16:25:58 user nova-compute[75097]: </domain>
Nov 14 16:25:58 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1794728049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1794728049',id=40,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWjMB38v0CHSDkExGfizMV0zkx+nG7JjphfeFbyPPwZ3oQOHA2qZimou3chjEHK5krBIFzvwqphV02HiERggD6J2WzHMOHBYLcjbGGeRGMlGQybngEsKFUOLhfrWuoYBg==',key_name='tempest-keypair-1203540656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-s23mde0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=8cf8cc4f-96f4-487a-8739-1fbedfd2d428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG os_vif [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bda3d877-1627-568d-b3e2-7f52e3b20edf', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38115c8f-85, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38115c8f-85, col_values=(('qos', UUID('4f2cb4f9-8314-4da7-ae29-cf846bfcd74b')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38115c8f-85, col_values=(('external_ids', {'iface-id': '38115c8f-855f-478e-9ca6-5066d79321af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c3:b7', 'vm-uuid': '8cf8cc4f-96f4-487a-8739-1fbedfd2d428'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:58 user nova-compute[75097]: INFO os_vif [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85')
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No VIF found with MAC fa:16:3e:83:c3:b7, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.network.neutron [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updated VIF entry in instance network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.network.neutron [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f39301e3-0a16-4f97-a3cb-e133e1ab9521 req-4b266fea-70d7-4cfe-9bba-efa9e455795d service nova] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:25:58 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-40c85c43-2471-4791-99cf-dbc0e6becfd7 req-f29fd074-6505-43eb-8d65-f7cc6ebc5611 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40c85c43-2471-4791-99cf-dbc0e6becfd7 req-f29fd074-6505-43eb-8d65-f7cc6ebc5611 service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40c85c43-2471-4791-99cf-dbc0e6becfd7 req-f29fd074-6505-43eb-8d65-f7cc6ebc5611 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-40c85c43-2471-4791-99cf-dbc0e6becfd7 req-f29fd074-6505-43eb-8d65-f7cc6ebc5611 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:25:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-40c85c43-2471-4791-99cf-dbc0e6becfd7 req-f29fd074-6505-43eb-8d65-f7cc6ebc5611 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:25:59 user nova-compute[75097]: WARNING nova.compute.manager [req-40c85c43-2471-4791-99cf-dbc0e6becfd7 req-f29fd074-6505-43eb-8d65-f7cc6ebc5611 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state building and task_state spawning.
Nov 14 16:26:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:26:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance spawned successfully.
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-816069aa-28b9-46fe-ae66-b0dad780ffe3 req-b97fcbb8-1fa5-4472-9806-482dc904606f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-816069aa-28b9-46fe-ae66-b0dad780ffe3 req-b97fcbb8-1fa5-4472-9806-482dc904606f service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-816069aa-28b9-46fe-ae66-b0dad780ffe3 req-b97fcbb8-1fa5-4472-9806-482dc904606f service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-816069aa-28b9-46fe-ae66-b0dad780ffe3 req-b97fcbb8-1fa5-4472-9806-482dc904606f service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-816069aa-28b9-46fe-ae66-b0dad780ffe3 req-b97fcbb8-1fa5-4472-9806-482dc904606f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:26:01 user nova-compute[75097]: WARNING nova.compute.manager [req-816069aa-28b9-46fe-ae66-b0dad780ffe3 req-b97fcbb8-1fa5-4472-9806-482dc904606f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state building and task_state spawning.
Nov 14 16:26:01 user nova-compute[75097]: INFO nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 14 16:26:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:26:01 user nova-compute[75097]: INFO nova.compute.manager [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Took 6.19 seconds to build instance.
Nov 14 16:26:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c404e39c-207a-4d05-8987-05458018394e tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:26:18 user nova-compute[75097]: INFO nova.compute.claims [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Claim successful on node user
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.network.neutron [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:26:18 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:26:18 user nova-compute[75097]: DEBUG nova.policy [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '743defe802c14f51aeff2032e10a7913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5eed0dd3da4aa9872bb394a5d771e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:26:19 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Creating image(s)
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "/opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "/opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk 1073741824" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Successfully created port: 0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Cannot resize image /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Ensure instance console log exists: /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:26:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Successfully updated port: 0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquired lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-changed-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.compute.manager [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Refreshing instance network info cache due to event network-changed-0566f110-993a-426c-8a35-71bf4625d335. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] Acquiring lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updating instance_info_cache with network_info: [{"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Releasing lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Instance network_info: |[{"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] Acquired lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.neutron [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Refreshing network info cache for port 0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Start _get_guest_xml network_info=[{"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:26:20 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:26:20 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:26:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2359542',id=41,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgEX2JQf2G9RZsZezbu8m3ZDna6/wmERVTYWOnkAqW9Kq8NTc4sZwyd196yV4+qgGXRzO+NpM3bL2Lg4DlO71OfqC/LN4+yQ0tlwOx4EONWsXoBADnaR3JVpzjxvNUqQQ==',key_name='tempest-keypair-52197546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c5eed0dd3da4aa9872bb394a5d771e8',ramdisk_id='',reservation_id='r-vbr3f9ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-668631944',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='743defe802c14f51aeff2032e10a7913',uuid=0d9e69be-e34c-4e32-b10b-e628c4cd9b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Converting VIF {"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:26:20 user nova-compute[75097]:   <uuid>0d9e69be-e34c-4e32-b10b-e628c4cd9b58</uuid>
Nov 14 16:26:20 user nova-compute[75097]:   <name>instance-00000029</name>
Nov 14 16:26:20 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:26:20 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:26:20 user nova-compute[75097]:   <metadata>
Nov 14 16:26:20 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:26:20 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:26:20 user nova-compute[75097]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282</nova:name>
Nov 14 16:26:20 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:26:20</nova:creationTime>
Nov 14 16:26:20 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:26:20 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:26:20 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:26:20 user nova-compute[75097]:       <nova:owner>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:user uuid="743defe802c14f51aeff2032e10a7913">tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member</nova:user>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:project uuid="6c5eed0dd3da4aa9872bb394a5d771e8">tempest-TestServerVolumeAttachScenarioOldVersion-668631944</nova:project>
Nov 14 16:26:20 user nova-compute[75097]:       </nova:owner>
Nov 14 16:26:20 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:26:20 user nova-compute[75097]:       <nova:ports>
Nov 14 16:26:20 user nova-compute[75097]:         <nova:port uuid="0566f110-993a-426c-8a35-71bf4625d335">
Nov 14 16:26:20 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 16:26:20 user nova-compute[75097]:         </nova:port>
Nov 14 16:26:20 user nova-compute[75097]:       </nova:ports>
Nov 14 16:26:20 user nova-compute[75097]:     </nova:instance>
Nov 14 16:26:20 user nova-compute[75097]:   </metadata>
Nov 14 16:26:20 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:26:20 user nova-compute[75097]:     <system>
Nov 14 16:26:20 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:26:20 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:26:20 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:26:20 user nova-compute[75097]:       <entry name="serial">0d9e69be-e34c-4e32-b10b-e628c4cd9b58</entry>
Nov 14 16:26:20 user nova-compute[75097]:       <entry name="uuid">0d9e69be-e34c-4e32-b10b-e628c4cd9b58</entry>
Nov 14 16:26:20 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:26:20 user nova-compute[75097]:     </system>
Nov 14 16:26:20 user nova-compute[75097]:   </sysinfo>
Nov 14 16:26:20 user nova-compute[75097]:   <os>
Nov 14 16:26:20 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:26:20 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:26:20 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:26:20 user nova-compute[75097]:   </os>
Nov 14 16:26:20 user nova-compute[75097]:   <features>
Nov 14 16:26:20 user nova-compute[75097]:     <acpi/>
Nov 14 16:26:20 user nova-compute[75097]:     <apic/>
Nov 14 16:26:20 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:26:20 user nova-compute[75097]:   </features>
Nov 14 16:26:20 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:26:20 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:26:20 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:26:20 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:26:20 user nova-compute[75097]:   </clock>
Nov 14 16:26:20 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:26:20 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:26:20 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:26:20 user nova-compute[75097]:   </cpu>
Nov 14 16:26:20 user nova-compute[75097]:   <devices>
Nov 14 16:26:20 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:26:20 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:26:20 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk"/>
Nov 14 16:26:20 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:26:20 user nova-compute[75097]:     </disk>
Nov 14 16:26:20 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:26:20 user nova-compute[75097]:       <mac address="fa:16:3e:6a:dc:4b"/>
Nov 14 16:26:20 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:26:20 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:26:20 user nova-compute[75097]:       <target dev="tap0566f110-99"/>
Nov 14 16:26:20 user nova-compute[75097]:     </interface>
Nov 14 16:26:20 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:26:20 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/console.log" append="off"/>
Nov 14 16:26:20 user nova-compute[75097]:     </serial>
Nov 14 16:26:20 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:26:20 user nova-compute[75097]:     <video>
Nov 14 16:26:20 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:26:20 user nova-compute[75097]:     </video>
Nov 14 16:26:20 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:26:20 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:26:20 user nova-compute[75097]:     </rng>
Nov 14 16:26:20 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:26:20 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:26:20 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:26:20 user nova-compute[75097]:     </memballoon>
Nov 14 16:26:20 user nova-compute[75097]:   </devices>
Nov 14 16:26:20 user nova-compute[75097]: </domain>
Nov 14 16:26:20 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:26:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2359542',id=41,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgEX2JQf2G9RZsZezbu8m3ZDna6/wmERVTYWOnkAqW9Kq8NTc4sZwyd196yV4+qgGXRzO+NpM3bL2Lg4DlO71OfqC/LN4+yQ0tlwOx4EONWsXoBADnaR3JVpzjxvNUqQQ==',key_name='tempest-keypair-52197546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c5eed0dd3da4aa9872bb394a5d771e8',ramdisk_id='',reservation_id='r-vbr3f9ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-668631944',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='743defe802c14f51aeff2032e10a7913',uuid=0d9e69be-e34c-4e32-b10b-e628c4cd9b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Converting VIF {"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG os_vif [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fc42c2f-86e0-5a01-8e25-dfc2c7e2ca22', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0566f110-99, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0566f110-99, col_values=(('qos', UUID('abdf68fa-3833-40e1-ab05-d0731069c926')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0566f110-99, col_values=(('external_ids', {'iface-id': '0566f110-993a-426c-8a35-71bf4625d335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:dc:4b', 'vm-uuid': '0d9e69be-e34c-4e32-b10b-e628c4cd9b58'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:20 user nova-compute[75097]: INFO os_vif [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99')
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:26:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] No VIF found with MAC fa:16:3e:6a:dc:4b, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updated VIF entry in instance network info cache for port 0566f110-993a-426c-8a35-71bf4625d335. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updating instance_info_cache with network_info: [{"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-85d21502-e577-462c-a260-e6e6d213a677 req-890a21ba-72d9-4562-9fda-ee0e190ac48b service nova] Releasing lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-changed-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Refreshing instance network info cache due to event network-changed-109ae602-6791-496c-8654-b5310a341a0f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] Acquiring lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] Acquired lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Refreshing network info cache for port 109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updated VIF entry in instance network info cache for port 109ae602-6791-496c-8654-b5310a341a0f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updating instance_info_cache with network_info: [{"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a5b02fc0-ff0a-41ec-a80f-1f47b7e0bceb req-067e9618-4865-485e-b965-2ee742001f0f service nova] Releasing lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:26:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-4f20aeb5-e66a-436b-94e1-337c58d8a925 req-be3335bc-6c4c-4110-94b4-08eecb3dbd18 service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4f20aeb5-e66a-436b-94e1-337c58d8a925 req-be3335bc-6c4c-4110-94b4-08eecb3dbd18 service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4f20aeb5-e66a-436b-94e1-337c58d8a925 req-be3335bc-6c4c-4110-94b4-08eecb3dbd18 service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4f20aeb5-e66a-436b-94e1-337c58d8a925 req-be3335bc-6c4c-4110-94b4-08eecb3dbd18 service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-4f20aeb5-e66a-436b-94e1-337c58d8a925 req-be3335bc-6c4c-4110-94b4-08eecb3dbd18 service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:26:22 user nova-compute[75097]: WARNING nova.compute.manager [req-4f20aeb5-e66a-436b-94e1-337c58d8a925 req-be3335bc-6c4c-4110-94b4-08eecb3dbd18 service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state building and task_state spawning.
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'flavor' on Instance uuid 281221f9-f7e4-4841-97a0-6dbfcf658a20 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:26:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:23 user nova-compute[75097]: INFO nova.compute.manager [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Attaching volume f047961b-bdac-428e-9050-565454f8ddf8 to /dev/vdb
Nov 14 16:26:23 user nova-compute[75097]: DEBUG os_brick.utils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a67522-7003-4664-a7a2-6c947a1f8d63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21f27e7-c39f-474d-8ec3-8219e30d7f5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[65902e2b-094c-4d95-938e-d7bee76ff290]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b20b3c-15fb-4838-9718-b8397054f157]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:26:23 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:26:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d39e7-c6fd-4313-9f26-623d916f7c9a]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG os_brick.utils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:26:23 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updating existing volume attachment record: 2f6a83be-da8a-4da2-9f93-4688b97c1d4d {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-3a82ccb5-46d3-4305-b638-6771afa52863 req-ab9c3334-4186-4fe4-b8a5-b1da9db19c36 service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3a82ccb5-46d3-4305-b638-6771afa52863 req-ab9c3334-4186-4fe4-b8a5-b1da9db19c36 service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3a82ccb5-46d3-4305-b638-6771afa52863 req-ab9c3334-4186-4fe4-b8a5-b1da9db19c36 service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3a82ccb5-46d3-4305-b638-6771afa52863 req-ab9c3334-4186-4fe4-b8a5-b1da9db19c36 service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-3a82ccb5-46d3-4305-b638-6771afa52863 req-ab9c3334-4186-4fe4-b8a5-b1da9db19c36 service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:26:24 user nova-compute[75097]: WARNING nova.compute.manager [req-3a82ccb5-46d3-4305-b638-6771afa52863 req-ab9c3334-4186-4fe4-b8a5-b1da9db19c36 service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state building and task_state spawning.
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:26:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Instance spawned successfully.
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:26:24 user nova-compute[75097]: INFO nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 14 16:26:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:26:24 user nova-compute[75097]: INFO nova.compute.manager [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Took 6.74 seconds to build instance.
Nov 14 16:26:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-04764056-9ad2-49cb-8ae6-1d72da6beb2d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQUXgxsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:26:27 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:26:27 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:26:27 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df71428-b8e4-4cba-8550-4b6a17182207]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:26:27 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0fa45c-2913-4e04-894b-71459ae3b629]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8] added
Nov 14 16:26:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eedbc9-473c-4118-8f6e-846518d11062]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[76751e83-eb91-4087-9092-05103371b08f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQUXgxsD {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQUXgxsD" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff7087-f286-43be-a728-e0b7502ba66e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RQUXgxsD'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[04078374-7d62-4c2b-8b71-7ee24a75edf3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbead253-dff1-4bd6-b51f-173bcb24e397]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:26:27 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:26:27 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:26:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:26:27 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:26:27 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:26:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:26:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c005588b-5fa4-4a72-ace4-6190241658a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260]
Nov 14 16:26:28 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260] successful.
Nov 14 16:26:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[30713e91-9f79-49a0-87d3-8ef4a4467c89]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee90333a-5fc4-4459-a463-554a3499357d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 (non-flash)
Nov 14 16:26:28 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0a8525-677d-4585-9b56-ba19791d2513]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:26:28 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQUXgxsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23366386264646536', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366386264646536', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'flavor' on Instance uuid 281221f9-f7e4-4841-97a0-6dbfcf658a20 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:26:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:26:29 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:26:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:26:29 user nova-compute[75097]:   <serial>f047961b-bdac-428e-9050-565454f8ddf8</serial>
Nov 14 16:26:29 user nova-compute[75097]: </disk>
Nov 14 16:26:29 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] No VIF found with MAC fa:16:3e:2a:f7:a8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:26:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ccd902b-b940-4299-af39-3e72ff882a66 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.666s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:31 user nova-compute[75097]: INFO nova.compute.manager [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Detaching volume f047961b-bdac-428e-9050-565454f8ddf8
Nov 14 16:26:31 user nova-compute[75097]: INFO nova.virt.block_device [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Attempting to driver detach volume f047961b-bdac-428e-9050-565454f8ddf8 from mountpoint /dev/vdb
Nov 14 16:26:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Attempting to detach device vdb from instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:26:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:26:31 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:26:31 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:26:31 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:26:31 user nova-compute[75097]:   <serial>f047961b-bdac-428e-9050-565454f8ddf8</serial>
Nov 14 16:26:31 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:26:31 user nova-compute[75097]: </disk>
Nov 14 16:26:31 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:26:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully detached device vdb from instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 from the persistent domain config.
Nov 14 16:26:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:26:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:26:31 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:26:31 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:26:31 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:26:31 user nova-compute[75097]:   <serial>f047961b-bdac-428e-9050-565454f8ddf8</serial>
Nov 14 16:26:31 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:26:31 user nova-compute[75097]: </disk>
Nov 14 16:26:31 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:26:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:26:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:26:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:26:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:26:51 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 is timed out.
Nov 14 16:26:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully detached device vdb from instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 from the live domain config.
Nov 14 16:26:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQUXgxsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:26:51 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9228d79a-5d4d-4141-9d5e-6895756506ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:26:51 user nova-compute[75097]: No targets found.
Nov 14 16:26:51 user nova-compute[75097]: iSNS:
Nov 14 16:26:51 user nova-compute[75097]: No targets found.
Nov 14 16:26:51 user nova-compute[75097]: STATIC:
Nov 14 16:26:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:26:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:26:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:26:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3
Nov 14 16:26:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:26:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:26:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:26:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:26:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:26:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8
Nov 14 16:26:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:26:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:26:51 user nova-compute[75097]: FIRMWARE:
Nov 14 16:26:51 user nova-compute[75097]: No targets found.
Nov 14 16:26:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:26:51 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:26:51 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c2e34-592e-42d4-b9f6-2bf7310b6a67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e99b1-9120-4f18-acd3-cfd5f73d4465]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 (non-flash)
Nov 14 16:26:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981ca7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf27b08c-e2fc-4d8d-b77c-60ea3a1725e9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a8c03d-6757-4325-8b9d-ecf42a47be86]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b20e9-9152-406b-a3d6-fcc089eda2b8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2649da77-cee4-4b01-a1f5-749e3cf0d7a1]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dafa16-e643-465e-b8d3-5ea481fed7b7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f667595-ed95-4e55-b78d-02460101971e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260]
Nov 14 16:26:51 user nova-compute[75097]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8, portal: 172.16.0.220,3260] successful.
Nov 14 16:26:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f047961b-bdac-428e-9050-565454f8ddf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e0c85-2f56-465a-aac8-27c0a8156e3b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] <== disconnect_volume: return (291ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:26:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:26:52 user nova-compute[75097]: DEBUG nova.objects.instance [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'flavor' on Instance uuid 281221f9-f7e4-4841-97a0-6dbfcf658a20 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:26:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-c41e297c-7bc8-424b-b0ee-b85110c5ee32 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updating instance_info_cache with network_info: [{"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-5a10a8dd-6ca4-4ada-aa74-e21278478d4f" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:26:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:26:58 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:26:58 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:26:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=7833MB free_disk=24.724552154541016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:26:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 94ce8238-e007-426f-9ad9-5d9a79ced856 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 281221f9-f7e4-4841-97a0-6dbfcf658a20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:26:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:03 user nova-compute[75097]: INFO nova.compute.manager [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Terminating instance
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-0fda4ef7-4168-45f3-a3e4-03f22aa3fb75 req-ac47a39d-b9a3-4966-ad54-5a150c044d29 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-vif-unplugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0fda4ef7-4168-45f3-a3e4-03f22aa3fb75 req-ac47a39d-b9a3-4966-ad54-5a150c044d29 service nova] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0fda4ef7-4168-45f3-a3e4-03f22aa3fb75 req-ac47a39d-b9a3-4966-ad54-5a150c044d29 service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0fda4ef7-4168-45f3-a3e4-03f22aa3fb75 req-ac47a39d-b9a3-4966-ad54-5a150c044d29 service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-0fda4ef7-4168-45f3-a3e4-03f22aa3fb75 req-ac47a39d-b9a3-4966-ad54-5a150c044d29 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] No waiting events found dispatching network-vif-unplugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-0fda4ef7-4168-45f3-a3e4-03f22aa3fb75 req-ac47a39d-b9a3-4966-ad54-5a150c044d29 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-vif-unplugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Instance destroyed successfully.
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'resources' on Instance uuid 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:25:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1023027050',display_name='tempest-TestVolumeBootPattern-server-1023027050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1023027050',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-vy7c2mv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:25:28Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=054897d6-c6f2-4d69-a9ad-a3d9e70cafdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "address": "fa:16:3e:7d:b1:2c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb037b73-61", "ovs_interfaceid": "fb037b73-61e8-4de7-b3b1-d28ec882ecbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_vif [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb037b73-61, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a6e52f8-d9f8-4ae0-b18f-7c402d222f6f) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:03 user nova-compute[75097]: INFO os_vif [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b1:2c,bridge_name='br-int',has_traffic_filtering=True,id=fb037b73-61e8-4de7-b3b1-d28ec882ecbf,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb037b73-61')
Nov 14 16:27:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pajRSOTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:27:03 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b724f9a-0b1c-405d-8b16-a54820f65910]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:27:03 user nova-compute[75097]: No targets found.
Nov 14 16:27:03 user nova-compute[75097]: iSNS:
Nov 14 16:27:03 user nova-compute[75097]: No targets found.
Nov 14 16:27:03 user nova-compute[75097]: STATIC:
Nov 14 16:27:03 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:27:03 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:27:03 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:27:03 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3
Nov 14 16:27:03 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:27:03 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:27:03 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:27:03 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:27:03 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:27:03 user nova-compute[75097]: FIRMWARE:
Nov 14 16:27:03 user nova-compute[75097]: No targets found.
Nov 14 16:27:03 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:27:03 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:27:03 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e318733-3d04-480d-820a-34f4badf3a7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0177944d-9db6-49ac-a6a9-68d747f202ce]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:27:03 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:27:03 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:27:03 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:27:03 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:27:03 user nova-compute[75097]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 (non-flash)
Nov 14 16:27:03 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf984a9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea663c95-79ee-4ab1-a3f0-321a9ee9946d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f6c3e-48f5-401b-9586-c067c921a0f8]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53010a0-1e08-4852-b62e-80b2bb4a1db6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e49ffe-1a86-4fe7-a42a-278a7d0f23e9]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4f788a75', '/dev/disk/by-id/scsi-23663623233343162', '/dev/disk/by-id/scsi-1SCST_BIO4f788a75-6cb2341b58e2a56d') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9804e43-e19c-44cd-ab0f-4d19f721bc0e]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c3eae-c134-4787-b590-3b92e85360d1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:27:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[36648ee5-2be9-41ff-bef3-f0236cb9c07c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260]
Nov 14 16:27:04 user nova-compute[75097]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3, portal: 172.16.0.220,3260] successful.
Nov 14 16:27:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00fbfcf4-51db-4552-8665-ac0056c67bb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff3503b-158f-41a8-b7e5-867205d7fcd5]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== disconnect_volume: return (291ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:27:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Deleting instance files /opt/stack/data/nova/instances/054897d6-c6f2-4d69-a9ad-a3d9e70cafdc_del
Nov 14 16:27:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Deletion of /opt/stack/data/nova/instances/054897d6-c6f2-4d69-a9ad-a3d9e70cafdc_del complete
Nov 14 16:27:04 user nova-compute[75097]: INFO nova.compute.manager [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 16:27:04 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:27:04 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:04 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Took 0.43 seconds to deallocate network for instance.
Nov 14 16:27:05 user nova-compute[75097]: INFO nova.compute.manager [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 16:27:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Deleting volume: 00fbfcf4-51db-4552-8665-ac0056c67bb3 {{(pid=75097) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] Acquiring lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] No waiting events found dispatching network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:05 user nova-compute[75097]: WARNING nova.compute.manager [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received unexpected event network-vif-plugged-fb037b73-61e8-4de7-b3b1-d28ec882ecbf for instance with vm_state active and task_state deleting.
Nov 14 16:27:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-cc174858-855a-4576-b404-5a64130c49c4 req-2725a618-ef5a-43ff-8ad7-76e49b709e93 service nova] [instance: 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc] Received event network-vif-deleted-fb037b73-61e8-4de7-b3b1-d28ec882ecbf {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:05 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Deleted allocations for instance 054897d6-c6f2-4d69-a9ad-a3d9e70cafdc
Nov 14 16:27:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2eb5aca7-57ce-4490-9e13-0d37f5b883c9 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "054897d6-c6f2-4d69-a9ad-a3d9e70cafdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.856s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:08 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:27:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:27:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:27:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-changed-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Refreshing instance network info cache due to event network-changed-109ae602-6791-496c-8654-b5310a341a0f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:27:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] Acquiring lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:27:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] Acquired lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:27:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Refreshing network info cache for port 109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:22 user nova-compute[75097]: INFO nova.compute.manager [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Terminating instance
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.network.neutron [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updated VIF entry in instance network info cache for port 109ae602-6791-496c-8654-b5310a341a0f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.network.neutron [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updating instance_info_cache with network_info: [{"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c6c149b8-c7d8-46c8-8ef4-b0cd8d612c15 req-818e17d7-e805-4b20-8f48-efdbfd2db39d service nova] Releasing lock "refresh_cache-281221f9-f7e4-4841-97a0-6dbfcf658a20" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:27:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Instance destroyed successfully.
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'resources' on Instance uuid 281221f9-f7e4-4841-97a0-6dbfcf658a20 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-930698619',display_name='tempest-TestStampPattern-server-930698619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-930698619',id=38,image_ref='276366ad-d6be-49fe-a180-58bb476ac18b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbs2YwP80IOgHAD4NMnt5vdrmpl7fZEhV1O1GdfggXQ4hLf7fZp3jF2/qIPcowDLKmtwQQ+3ReVQ1RBSOK4/wv8tfl5WIvkE/weu2QpYUM+/xPDHk3JFkaKTleUxqTr3Q==',key_name='tempest-TestStampPattern-1197072316',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e13dd81460e04ef0a3ef496334da5241',ramdisk_id='',reservation_id='r-30gfnwag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a77934ca-8e15-4158-9d25-cd20427d5b07',image_min_disk='1',image_min_ram='0',image_owner_id='e13dd81460e04ef0a3ef496334da5241',image_owner_project_name='tempest-TestStampPattern-1146793101',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1146793101-project-member',image_user_id='53827b8c6b514b68987dd448fbc17bcd',owner_project_name='tempest-TestStampPattern-1146793101',owner_user_name='tempest-TestStampPattern-1146793101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:24:36Z,user_data=None,user_id='53827b8c6b514b68987dd448fbc17bcd',uuid=281221f9-f7e4-4841-97a0-6dbfcf658a20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converting VIF {"id": "109ae602-6791-496c-8654-b5310a341a0f", "address": "fa:16:3e:2a:f7:a8", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109ae602-67", "ovs_interfaceid": "109ae602-6791-496c-8654-b5310a341a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG os_vif [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap109ae602-67, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9331986-184b-49c9-849d-9b9866fd1099) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:22 user nova-compute[75097]: INFO os_vif [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=109ae602-6791-496c-8654-b5310a341a0f,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109ae602-67')
Nov 14 16:27:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Deleting instance files /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20_del
Nov 14 16:27:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Deletion of /opt/stack/data/nova/instances/281221f9-f7e4-4841-97a0-6dbfcf658a20_del complete
Nov 14 16:27:22 user nova-compute[75097]: INFO nova.compute.manager [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 16:27:22 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:27:22 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:23 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Took 0.46 seconds to deallocate network for instance.
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:23 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Deleted allocations for instance 281221f9-f7e4-4841-97a0-6dbfcf658a20
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f368aa6-e93a-468c-bdd1-b6cca6be2b6b tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-vif-unplugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] No waiting events found dispatching network-vif-unplugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:23 user nova-compute[75097]: WARNING nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received unexpected event network-vif-unplugged-109ae602-6791-496c-8654-b5310a341a0f for instance with vm_state deleted and task_state None.
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] Acquiring lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] Lock "281221f9-f7e4-4841-97a0-6dbfcf658a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] No waiting events found dispatching network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:23 user nova-compute[75097]: WARNING nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received unexpected event network-vif-plugged-109ae602-6791-496c-8654-b5310a341a0f for instance with vm_state deleted and task_state None.
Nov 14 16:27:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-eed825de-4b24-46ae-847d-54829ab0b005 req-41e373c5-10ab-4d8a-9bfa-91de35c6bf55 service nova] [instance: 281221f9-f7e4-4841-97a0-6dbfcf658a20] Received event network-vif-deleted-109ae602-6791-496c-8654-b5310a341a0f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:34 user nova-compute[75097]: INFO nova.compute.manager [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Terminating instance
Nov 14 16:27:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-9686cb66-30b7-4e00-a36d-8579ad257646 req-3f54d883-43e7-4b2a-9a69-0a7e7eea2b40 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9686cb66-30b7-4e00-a36d-8579ad257646 req-3f54d883-43e7-4b2a-9a69-0a7e7eea2b40 service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9686cb66-30b7-4e00-a36d-8579ad257646 req-3f54d883-43e7-4b2a-9a69-0a7e7eea2b40 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9686cb66-30b7-4e00-a36d-8579ad257646 req-3f54d883-43e7-4b2a-9a69-0a7e7eea2b40 service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-9686cb66-30b7-4e00-a36d-8579ad257646 req-3f54d883-43e7-4b2a-9a69-0a7e7eea2b40 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-9686cb66-30b7-4e00-a36d-8579ad257646 req-3f54d883-43e7-4b2a-9a69-0a7e7eea2b40 service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-unplugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Instance destroyed successfully.
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'resources' on Instance uuid 94ce8238-e007-426f-9ad9-5d9a79ced856 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437597157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437597157',id=36,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-buxxzh1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:25:50Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=94ce8238-e007-426f-9ad9-5d9a79ced856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "22af481a-a342-44f4-9e02-e846c803b865", "address": "fa:16:3e:46:c8:14", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af481a-a3", "ovs_interfaceid": "22af481a-a342-44f4-9e02-e846c803b865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_vif [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22af481a-a3, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d0c8986-4276-4001-ac64-051da1ea0dac) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:35 user nova-compute[75097]: INFO os_vif [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:c8:14,bridge_name='br-int',has_traffic_filtering=True,id=22af481a-a342-44f4-9e02-e846c803b865,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af481a-a3')
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'huByacmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:27:35 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8795ee-3ff7-4dbe-94c5-146bf55f6c06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:27:35 user nova-compute[75097]: No targets found.
Nov 14 16:27:35 user nova-compute[75097]: iSNS:
Nov 14 16:27:35 user nova-compute[75097]: No targets found.
Nov 14 16:27:35 user nova-compute[75097]: STATIC:
Nov 14 16:27:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:27:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:27:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:27:35 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595
Nov 14 16:27:35 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:27:35 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:27:35 user nova-compute[75097]: FIRMWARE:
Nov 14 16:27:35 user nova-compute[75097]: No targets found.
Nov 14 16:27:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:27:35 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:27:35 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b0b74-2b34-49fc-b53a-5db29d9904fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540f0e0-32ba-45bc-9b22-f01ff48e9456]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:27:35 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:27:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:27:35 user nova-compute[75097]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 (non-flash)
Nov 14 16:27:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf984451b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595'): ({'sde'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Removing single pathed devices sde {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f2f85b-0090-4bac-8204-1fe7715735ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11c2e06-08dc-4fc7-862a-7ab316df7e8a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flushing IO for device /dev/sde {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89fe3aa-5a59-4cf9-9f9d-c2aa53752004]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e5684-38b7-4feb-bc76-35b046cff64c]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] SCSI volumes sde have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dd0d0f34', '/dev/disk/by-id/scsi-1SCST_BIOdd0d0f34-b07f7ed812e355f2', '/dev/disk/by-id/scsi-26230376637656438') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347a298-7364-4f6b-87f6-c23a9f435afe]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e01cb-7d16-4963-9f24-76b204f37339]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b382189c-7bb6-4c59-bdaa-98fdd025b4a7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260]
Nov 14 16:27:35 user nova-compute[75097]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595, portal: 172.16.0.220,3260] successful.
Nov 14 16:27:35 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa25e5b6-50cf-4b34-92d5-d2dcac9bf595 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be67c6f-b0eb-4ef1-987f-66c648c11331]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== disconnect_volume: return (281ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:27:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Deleting instance files /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856_del
Nov 14 16:27:35 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Deletion of /opt/stack/data/nova/instances/94ce8238-e007-426f-9ad9-5d9a79ced856_del complete
Nov 14 16:27:35 user nova-compute[75097]: INFO nova.compute.manager [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 16:27:35 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:27:35 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:27:36 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:36 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Took 0.49 seconds to deallocate network for instance.
Nov 14 16:27:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] Acquiring lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] No waiting events found dispatching network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:36 user nova-compute[75097]: WARNING nova.compute.manager [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received unexpected event network-vif-plugged-22af481a-a342-44f4-9e02-e846c803b865 for instance with vm_state active and task_state deleting.
Nov 14 16:27:36 user nova-compute[75097]: DEBUG nova.compute.manager [req-2abe1a4e-87c5-4d4a-a1ff-f64f6e76f77a req-bf71179d-58cc-49f6-a387-662cdd87c07b service nova] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Received event network-vif-deleted-22af481a-a342-44f4-9e02-e846c803b865 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:36 user nova-compute[75097]: INFO nova.compute.manager [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 94ce8238-e007-426f-9ad9-5d9a79ced856] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 16:27:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:27:37 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:27:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:37 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Deleted allocations for instance 94ce8238-e007-426f-9ad9-5d9a79ced856
Nov 14 16:27:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d7cbc506-6cf1-4040-bfab-d891347b50b0 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "94ce8238-e007-426f-9ad9-5d9a79ced856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-changed-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG nova.compute.manager [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing instance network info cache due to event network-changed-38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG nova.network.neutron [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG nova.network.neutron [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updated VIF entry in instance network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG nova.network.neutron [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:46 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e80ad491-5a07-46e4-a683-e0a711fa2484 req-c39f822d-f34f-453c-b366-4057b925a47e service nova] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:49 user nova-compute[75097]: INFO nova.compute.manager [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Shelving
Nov 14 16:27:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc6ec4d6-39d3-4140-af55-5cb633b2eea3 req-670466f4-8012-41e7-8d57-022c9a0a74f2 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-unplugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc6ec4d6-39d3-4140-af55-5cb633b2eea3 req-670466f4-8012-41e7-8d57-022c9a0a74f2 service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc6ec4d6-39d3-4140-af55-5cb633b2eea3 req-670466f4-8012-41e7-8d57-022c9a0a74f2 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc6ec4d6-39d3-4140-af55-5cb633b2eea3 req-670466f4-8012-41e7-8d57-022c9a0a74f2 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc6ec4d6-39d3-4140-af55-5cb633b2eea3 req-670466f4-8012-41e7-8d57-022c9a0a74f2 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-unplugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:49 user nova-compute[75097]: WARNING nova.compute.manager [req-fc6ec4d6-39d3-4140-af55-5cb633b2eea3 req-670466f4-8012-41e7-8d57-022c9a0a74f2 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-unplugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state active and task_state shelving.
Nov 14 16:27:49 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance destroyed successfully.
Nov 14 16:27:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:49 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Beginning cold snapshot process
Nov 14 16:27:50 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:27:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk /opt/stack/data/nova/instances/snapshots/tmpl7qsjes1/d3ce024b07944811a104009c10528367 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk /opt/stack/data/nova/instances/snapshots/tmpl7qsjes1/d3ce024b07944811a104009c10528367" returned: 0 in 0.594s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Snapshot extracted, beginning image upload
Nov 14 16:27:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-bb90bc11-4e4f-40a4-8cd9-7af61648238c req-7faa939b-ac6b-4c9b-8616-541ea26f33c0 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bb90bc11-4e4f-40a4-8cd9-7af61648238c req-7faa939b-ac6b-4c9b-8616-541ea26f33c0 service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bb90bc11-4e4f-40a4-8cd9-7af61648238c req-7faa939b-ac6b-4c9b-8616-541ea26f33c0 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bb90bc11-4e4f-40a4-8cd9-7af61648238c req-7faa939b-ac6b-4c9b-8616-541ea26f33c0 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-bb90bc11-4e4f-40a4-8cd9-7af61648238c req-7faa939b-ac6b-4c9b-8616-541ea26f33c0 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:27:51 user nova-compute[75097]: WARNING nova.compute.manager [req-bb90bc11-4e4f-40a4-8cd9-7af61648238c req-7faa939b-ac6b-4c9b-8616-541ea26f33c0 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 16:27:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 5a10a8dd-6ca4-4ada-aa74-e21278478d4f {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:53 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Snapshot image upload complete
Nov 14 16:27:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:27:53 user nova-compute[75097]: INFO nova.compute.manager [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Shelve offloading
Nov 14 16:27:53 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance destroyed successfully.
Nov 14 16:27:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:27:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:27:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:27:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:27:53 user nova-compute[75097]: DEBUG nova.network.neutron [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:27:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance destroyed successfully.
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'resources' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1794728049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1794728049',id=40,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWjMB38v0CHSDkExGfizMV0zkx+nG7JjphfeFbyPPwZ3oQOHA2qZimou3chjEHK5krBIFzvwqphV02HiERggD6J2WzHMOHBYLcjbGGeRGMlGQybngEsKFUOLhfrWuoYBg==',key_name='tempest-keypair-1203540656',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:26:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-s23mde0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member',shelved_at='2023-11-14T16:27:53.059528',shelved_host='user',shelved_image_id='70622b30-818c-4a49-8650-a86b4ee519f6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=8cf8cc4f-96f4-487a-8739-1fbedfd2d428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG os_vif [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38115c8f-85, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f2cb4f9-8314-4da7-ae29-cf846bfcd74b) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-changed-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing instance network info cache due to event network-changed-38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:27:54 user nova-compute[75097]: INFO os_vif [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85')
Nov 14 16:27:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Deleting instance files /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428_del
Nov 14 16:27:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Deletion of /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428_del complete
Nov 14 16:27:54 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Deleted allocations for instance 8cf8cc4f-96f4-487a-8739-1fbedfd2d428
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.objects.base [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<8cf8cc4f-96f4-487a-8739-1fbedfd2d428> lazy-loaded attributes: resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updated VIF entry in instance network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap38115c8f-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-29d49005-c3e1-4ac0-a1df-3b2aa6327207 req-011c5fd0-47ab-4a7d-aa7c-00652a80459f service nova] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-46bdf0b9-3ae0-43eb-8ab5-3d40a0300a92 tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.687s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.740s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:54 user nova-compute[75097]: INFO nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] During sync_power_state the instance has a pending task (shelving_image_uploading). Skip.
Nov 14 16:27:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:55 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [{"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:27:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:27:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:27:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:27:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8479MB free_disk=24.703227996826172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a77934ca-8e15-4158-9d25-cd20427d5b07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:27:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:28:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "20a52802-02e2-42df-aeae-63e5572d5564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:28:02 user nova-compute[75097]: INFO nova.compute.claims [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Claim successful on node user
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:28:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:28:02 user nova-compute[75097]: INFO nova.virt.block_device [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Booting with volume 46f84216-6c6f-45ae-8207-7c7d585306b2 at /dev/vda
Nov 14 16:28:02 user nova-compute[75097]: DEBUG nova.policy [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc348d16cb0415fbbb357b7f030798e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea103d756c514917ae4aeb70b70b9097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG os_brick.utils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d7054-fd5b-4924-b1af-4bf60f201958]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f907ce4-249a-45d2-9278-9c810431141a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb927a64-5e4c-495f-8c2a-78976cd81c7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[91878f50-c17c-4b01-a488-f9d1d5314cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:28:03 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48b693-ac7a-45d2-a66b-0a8c51f753ac]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG os_brick.utils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating existing volume attachment record: ed6fa57a-5498-49a3-a813-9648cc4057c9 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:03 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Successfully created port: 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Successfully updated port: 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquired lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-changed-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Refreshing instance network info cache due to event network-changed-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] Acquiring lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating instance_info_cache with network_info: [{"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Releasing lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Instance network_info: |[{"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] Acquired lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Refreshing network info cache for port 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updated VIF entry in instance network info cache for port 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating instance_info_cache with network_info: [{"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-67f1bbdd-6c33-4fa1-8538-c00922a7f22e req-39f1e1e8-b767-4b38-88da-cc94a667bde1 service nova] Releasing lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:28:07 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Creating image(s)
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Ensure instance console log exists: /opt/stack/data/nova/instances/20a52802-02e2-42df-aeae-63e5572d5564/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Start _get_guest_xml network_info=[{"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNYprPQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20a52802-02e2-42df-aeae-63e5572d5564', 'attached_at': '', 'detached_at': '', 'volume_id': '46f84216-6c6f-45ae-8207-7c7d585306b2', 'serial': '46f84216-6c6f-45ae-8207-7c7d585306b2'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'ed6fa57a-5498-49a3-a813-9648cc4057c9', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:28:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:28:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNYprPQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:28:07 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:28:07 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:28:07 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd03d7af-fee5-45c1-89f3-7deb10cee0ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:28:07 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc96d1b-beb3-439d-b4e4-e742bf45ae5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2] added
Nov 14 16:28:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53d4ef-ce8f-443c-acc7-309c3aa110aa]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2290433-3406-4f3e-a0c5-981b3f790f07]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNYprPQx {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNYprPQx" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b359a7a-163b-4893-aca1-64aeee1ee151]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNYprPQx'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f37a99-d318-4664-985a-ff0c0369e2ba]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[633925aa-e504-42bf-9935-7a86ccade64a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4a510c-7d9e-40e0-8fc6-c862d2f01bf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260]
Nov 14 16:28:07 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260] successful.
Nov 14 16:28:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae4ead-4c7a-42fa-b99a-76cc762360e9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1415d95-eb2b-47dc-9113-268968b08145]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:07 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:07 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:07 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ac0cd-31f9-40fa-bd02-6d3cae8dcfd2]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:28:07 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNYprPQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23366653739356634', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366653739356634', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2074208297',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2074208297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2074208297',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpDmmP5Jgh0hvzmw25gJLMWJOEMnYJPGtlcXu7RaArAJechsqV/3dtfUb2KXiws7cYgkreD0098jvqX3nxEf0QDRO2eZY7tIvhVPXNS0o6pASY9NPJ/3zzDuoRbtYAuOw==',key_name='tempest-keypair-891506828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-u7v5vbq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=20a52802-02e2-42df-aeae-63e5572d5564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.objects.instance [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'pci_devices' on Instance uuid 20a52802-02e2-42df-aeae-63e5572d5564 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:28:08 user nova-compute[75097]:   <uuid>20a52802-02e2-42df-aeae-63e5572d5564</uuid>
Nov 14 16:28:08 user nova-compute[75097]:   <name>instance-0000002a</name>
Nov 14 16:28:08 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:28:08 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:28:08 user nova-compute[75097]:   <metadata>
Nov 14 16:28:08 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:28:08 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:28:08 user nova-compute[75097]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2074208297</nova:name>
Nov 14 16:28:08 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:28:07</nova:creationTime>
Nov 14 16:28:08 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:28:08 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:28:08 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:28:08 user nova-compute[75097]:       <nova:owner>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:user uuid="7dc348d16cb0415fbbb357b7f030798e">tempest-TestVolumeBootPattern-1353533810-project-member</nova:user>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:project uuid="ea103d756c514917ae4aeb70b70b9097">tempest-TestVolumeBootPattern-1353533810</nova:project>
Nov 14 16:28:08 user nova-compute[75097]:       </nova:owner>
Nov 14 16:28:08 user nova-compute[75097]:       <nova:ports>
Nov 14 16:28:08 user nova-compute[75097]:         <nova:port uuid="7e0afcb7-16b8-4e53-8889-fbecd6df1e4f">
Nov 14 16:28:08 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 16:28:08 user nova-compute[75097]:         </nova:port>
Nov 14 16:28:08 user nova-compute[75097]:       </nova:ports>
Nov 14 16:28:08 user nova-compute[75097]:     </nova:instance>
Nov 14 16:28:08 user nova-compute[75097]:   </metadata>
Nov 14 16:28:08 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:28:08 user nova-compute[75097]:     <system>
Nov 14 16:28:08 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:28:08 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:28:08 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:28:08 user nova-compute[75097]:       <entry name="serial">20a52802-02e2-42df-aeae-63e5572d5564</entry>
Nov 14 16:28:08 user nova-compute[75097]:       <entry name="uuid">20a52802-02e2-42df-aeae-63e5572d5564</entry>
Nov 14 16:28:08 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:28:08 user nova-compute[75097]:     </system>
Nov 14 16:28:08 user nova-compute[75097]:   </sysinfo>
Nov 14 16:28:08 user nova-compute[75097]:   <os>
Nov 14 16:28:08 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:28:08 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:28:08 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:28:08 user nova-compute[75097]:   </os>
Nov 14 16:28:08 user nova-compute[75097]:   <features>
Nov 14 16:28:08 user nova-compute[75097]:     <acpi/>
Nov 14 16:28:08 user nova-compute[75097]:     <apic/>
Nov 14 16:28:08 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:28:08 user nova-compute[75097]:   </features>
Nov 14 16:28:08 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:28:08 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:28:08 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:28:08 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:28:08 user nova-compute[75097]:   </clock>
Nov 14 16:28:08 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:28:08 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:28:08 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:28:08 user nova-compute[75097]:   </cpu>
Nov 14 16:28:08 user nova-compute[75097]:   <devices>
Nov 14 16:28:08 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:28:08 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:28:08 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:28:08 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:28:08 user nova-compute[75097]:       <serial>46f84216-6c6f-45ae-8207-7c7d585306b2</serial>
Nov 14 16:28:08 user nova-compute[75097]:     </disk>
Nov 14 16:28:08 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:28:08 user nova-compute[75097]:       <mac address="fa:16:3e:4f:70:7f"/>
Nov 14 16:28:08 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:28:08 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:28:08 user nova-compute[75097]:       <target dev="tap7e0afcb7-16"/>
Nov 14 16:28:08 user nova-compute[75097]:     </interface>
Nov 14 16:28:08 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:28:08 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/20a52802-02e2-42df-aeae-63e5572d5564/console.log" append="off"/>
Nov 14 16:28:08 user nova-compute[75097]:     </serial>
Nov 14 16:28:08 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:28:08 user nova-compute[75097]:     <video>
Nov 14 16:28:08 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:28:08 user nova-compute[75097]:     </video>
Nov 14 16:28:08 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:28:08 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:28:08 user nova-compute[75097]:     </rng>
Nov 14 16:28:08 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:28:08 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:28:08 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:28:08 user nova-compute[75097]:     </memballoon>
Nov 14 16:28:08 user nova-compute[75097]:   </devices>
Nov 14 16:28:08 user nova-compute[75097]: </domain>
Nov 14 16:28:08 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2074208297',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2074208297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2074208297',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpDmmP5Jgh0hvzmw25gJLMWJOEMnYJPGtlcXu7RaArAJechsqV/3dtfUb2KXiws7cYgkreD0098jvqX3nxEf0QDRO2eZY7tIvhVPXNS0o6pASY9NPJ/3zzDuoRbtYAuOw==',key_name='tempest-keypair-891506828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-u7v5vbq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=20a52802-02e2-42df-aeae-63e5572d5564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG os_vif [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5df60804-8b56-54ce-84fd-3c5f263d0cad', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e0afcb7-16, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e0afcb7-16, col_values=(('qos', UUID('9ed16662-18a8-4e0b-ab0c-e7e937c9d6b4')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e0afcb7-16, col_values=(('external_ids', {'iface-id': '7e0afcb7-16b8-4e53-8889-fbecd6df1e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:70:7f', 'vm-uuid': '20a52802-02e2-42df-aeae-63e5572d5564'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:08 user nova-compute[75097]: INFO os_vif [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16')
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No VIF found with MAC fa:16:3e:4f:70:7f, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-changed-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Refreshing instance network info cache due to event network-changed-0566f110-993a-426c-8a35-71bf4625d335. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] Acquiring lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] Acquired lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:28:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Refreshing network info cache for port 0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:28:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updated VIF entry in instance network info cache for port 0566f110-993a-426c-8a35-71bf4625d335. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:28:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updating instance_info_cache with network_info: [{"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f9421337-d9c1-4e30-8fd1-7b5b3734d325 req-618f1fc1-6f17-4bb6-9736-62efa369391b service nova] Releasing lock "refresh_cache-0d9e69be-e34c-4e32-b10b-e628c4cd9b58" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-cdfb675b-1d36-4eeb-9fae-7c3562f15068 req-6e89812c-3e34-478c-8d80-80c6fff52875 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cdfb675b-1d36-4eeb-9fae-7c3562f15068 req-6e89812c-3e34-478c-8d80-80c6fff52875 service nova] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cdfb675b-1d36-4eeb-9fae-7c3562f15068 req-6e89812c-3e34-478c-8d80-80c6fff52875 service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cdfb675b-1d36-4eeb-9fae-7c3562f15068 req-6e89812c-3e34-478c-8d80-80c6fff52875 service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-cdfb675b-1d36-4eeb-9fae-7c3562f15068 req-6e89812c-3e34-478c-8d80-80c6fff52875 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] No waiting events found dispatching network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:28:10 user nova-compute[75097]: WARNING nova.compute.manager [req-cdfb675b-1d36-4eeb-9fae-7c3562f15068 req-6e89812c-3e34-478c-8d80-80c6fff52875 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received unexpected event network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f for instance with vm_state building and task_state spawning.
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lazy-loading 'flavor' on Instance uuid 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:28:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:11 user nova-compute[75097]: INFO nova.compute.manager [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Attaching volume 8cd674a6-7d90-4dcd-bd7a-9e570f4a26df to /dev/vdb
Nov 14 16:28:11 user nova-compute[75097]: DEBUG os_brick.utils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c99f7-952b-4ba8-84e0-df2ee72bc966]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4beda2e-f137-4524-a7a4-efef49dfcdac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a859230-0cc6-4d80-83bb-6a7f67015389]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7816b8f0-9acf-48f4-8df4-e6a1de70b721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:28:11 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:28:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec64778-017a-4e59-9f56-5df3a6a203d9]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG os_brick.utils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updating existing volume attachment record: 23fc97e2-88b8-4af6-a317-ff20eee2e172 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:28:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:28:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Instance spawned successfully.
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:28:12 user nova-compute[75097]: INFO nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:28:12 user nova-compute[75097]: INFO nova.compute.manager [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Took 10.06 seconds to build instance.
Nov 14 16:28:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cdf1060e-87c8-400d-b35c-48ffeea634a4 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "20a52802-02e2-42df-aeae-63e5572d5564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.163s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-c4bb772a-2dcd-406f-8c2e-093fa55e8a26 req-70afecb0-f2ff-47e3-ba49-021c07b9375d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c4bb772a-2dcd-406f-8c2e-093fa55e8a26 req-70afecb0-f2ff-47e3-ba49-021c07b9375d service nova] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c4bb772a-2dcd-406f-8c2e-093fa55e8a26 req-70afecb0-f2ff-47e3-ba49-021c07b9375d service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c4bb772a-2dcd-406f-8c2e-093fa55e8a26 req-70afecb0-f2ff-47e3-ba49-021c07b9375d service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-c4bb772a-2dcd-406f-8c2e-093fa55e8a26 req-70afecb0-f2ff-47e3-ba49-021c07b9375d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] No waiting events found dispatching network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:28:12 user nova-compute[75097]: WARNING nova.compute.manager [req-c4bb772a-2dcd-406f-8c2e-093fa55e8a26 req-70afecb0-f2ff-47e3-ba49-021c07b9375d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received unexpected event network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f for instance with vm_state active and task_state None.
Nov 14 16:28:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNHyIdnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:28:15 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:28:15 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:28:15 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[01141ce9-1bc3-4b7c-8a59-899688f559de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:28:15 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[336de333-e937-4800-b28b-11d0b6fc4b68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df] added
Nov 14 16:28:15 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd88427-84df-4198-9243-8cfdfb9a7bae]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6bbb37-6872-434a-bc06-f1c0b3efbc3b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNHyIdnP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNHyIdnP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[18364cde-7697-4d99-bc36-b649b257713c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNHyIdnP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[96702dc6-9ddb-426c-ae84-e98dfec0308a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada4376-eefa-4e04-a18d-2c65f326167d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:15 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:15 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:15 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:15 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc41a379-4558-460c-a4fa-04064c59f801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260]
Nov 14 16:28:15 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260] successful.
Nov 14 16:28:15 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec7aff7-c81f-432b-bf55-8c2ea139a753]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c02e42d-eeb0-4de2-ba7b-ad69a588658b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:16 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:16 user nova-compute[75097]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df (non-flash)
Nov 14 16:28:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:16 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:16 user nova-compute[75097]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df (non-flash)
Nov 14 16:28:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce307b-710a-4b24-8877-f0ce2f75d1a9]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNHyIdnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-changed-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Refreshing instance network info cache due to event network-changed-1a9de883-33f2-4e14-8f36-702ceed50640. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] Acquiring lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] Acquired lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG nova.network.neutron [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Refreshing network info cache for port 1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:16 user nova-compute[75097]: INFO nova.compute.manager [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Terminating instance
Nov 14 16:28:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23061643832623564', 'path': '/dev/sdd'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061643832623564', 'path': '/dev/sdd'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lazy-loading 'flavor' on Instance uuid 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:28:17 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:28:17 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:28:17 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:28:17 user nova-compute[75097]:   <serial>8cd674a6-7d90-4dcd-bd7a-9e570f4a26df</serial>
Nov 14 16:28:17 user nova-compute[75097]: </disk>
Nov 14 16:28:17 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-fa433161-c7c3-4693-b032-475e28ece2c1 req-7ee2dce5-0adc-4d0e-8e3d-34a01b25ca69 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-vif-unplugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fa433161-c7c3-4693-b032-475e28ece2c1 req-7ee2dce5-0adc-4d0e-8e3d-34a01b25ca69 service nova] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fa433161-c7c3-4693-b032-475e28ece2c1 req-7ee2dce5-0adc-4d0e-8e3d-34a01b25ca69 service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fa433161-c7c3-4693-b032-475e28ece2c1 req-7ee2dce5-0adc-4d0e-8e3d-34a01b25ca69 service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-fa433161-c7c3-4693-b032-475e28ece2c1 req-7ee2dce5-0adc-4d0e-8e3d-34a01b25ca69 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] No waiting events found dispatching network-vif-unplugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-fa433161-c7c3-4693-b032-475e28ece2c1 req-7ee2dce5-0adc-4d0e-8e3d-34a01b25ca69 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-vif-unplugged-1a9de883-33f2-4e14-8f36-702ceed50640 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] No VIF found with MAC fa:16:3e:6a:dc:4b, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updated VIF entry in instance network info cache for port 1a9de883-33f2-4e14-8f36-702ceed50640. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [{"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d273fe8-a52d-4d2a-8b10-48c7f476feb9 req-a39bc8be-ca40-4f88-9f0f-a84c95418986 service nova] Releasing lock "refresh_cache-a77934ca-8e15-4158-9d25-cd20427d5b07" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebce1e31-ba9d-4149-a11f-3c2afbe1a5a4 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.559s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Instance destroyed successfully.
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.objects.instance [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lazy-loading 'resources' on Instance uuid a77934ca-8e15-4158-9d25-cd20427d5b07 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1835236991',display_name='tempest-TestStampPattern-server-1835236991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1835236991',id=35,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbs2YwP80IOgHAD4NMnt5vdrmpl7fZEhV1O1GdfggXQ4hLf7fZp3jF2/qIPcowDLKmtwQQ+3ReVQ1RBSOK4/wv8tfl5WIvkE/weu2QpYUM+/xPDHk3JFkaKTleUxqTr3Q==',key_name='tempest-TestStampPattern-1197072316',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e13dd81460e04ef0a3ef496334da5241',ramdisk_id='',reservation_id='r-yo4gu7q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1146793101',owner_user_name='tempest-TestStampPattern-1146793101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:24:28Z,user_data=None,user_id='53827b8c6b514b68987dd448fbc17bcd',uuid=a77934ca-8e15-4158-9d25-cd20427d5b07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converting VIF {"id": "1a9de883-33f2-4e14-8f36-702ceed50640", "address": "fa:16:3e:33:fa:87", "network": {"id": "891e7975-49cc-4219-8af5-eefdaac6705f", "bridge": "br-int", "label": "tempest-TestStampPattern-219237569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13dd81460e04ef0a3ef496334da5241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9de883-33", "ovs_interfaceid": "1a9de883-33f2-4e14-8f36-702ceed50640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG os_vif [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9de883-33, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4a32b62-9ba5-4457-bded-9bad1d5da594) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:28:17 user nova-compute[75097]: INFO os_vif [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=1a9de883-33f2-4e14-8f36-702ceed50640,network=Network(891e7975-49cc-4219-8af5-eefdaac6705f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9de883-33')
Nov 14 16:28:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Deleting instance files /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07_del
Nov 14 16:28:17 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Deletion of /opt/stack/data/nova/instances/a77934ca-8e15-4158-9d25-cd20427d5b07_del complete
Nov 14 16:28:17 user nova-compute[75097]: INFO nova.compute.manager [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 14 16:28:17 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:28:17 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-2cbff959-4982-43f1-b214-0a9d377b6ccb req-22135bb2-5807-4fb1-b910-3379a8afd29a service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-vif-deleted-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:18 user nova-compute[75097]: INFO nova.compute.manager [req-2cbff959-4982-43f1-b214-0a9d377b6ccb req-22135bb2-5807-4fb1-b910-3379a8afd29a service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Neutron deleted interface 1a9de883-33f2-4e14-8f36-702ceed50640; detaching it from the instance and deleting it from the info cache
Nov 14 16:28:18 user nova-compute[75097]: DEBUG nova.network.neutron [req-2cbff959-4982-43f1-b214-0a9d377b6ccb req-22135bb2-5807-4fb1-b910-3379a8afd29a service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:18 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Took 0.47 seconds to deallocate network for instance.
Nov 14 16:28:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-2cbff959-4982-43f1-b214-0a9d377b6ccb req-22135bb2-5807-4fb1-b910-3379a8afd29a service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Detach interface failed, port_id=1a9de883-33f2-4e14-8f36-702ceed50640, reason: Instance a77934ca-8e15-4158-9d25-cd20427d5b07 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:28:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:18 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Deleted allocations for instance a77934ca-8e15-4158-9d25-cd20427d5b07
Nov 14 16:28:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-096de589-0636-4499-8aac-634f1c6b6db3 tempest-TestStampPattern-1146793101 tempest-TestStampPattern-1146793101-project-member] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-7a5c8ec1-7f2e-4241-a4d1-d66bee4ff1e1 req-b9188bbd-c3c0-4f3c-b564-85f0f5151415 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received event network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7a5c8ec1-7f2e-4241-a4d1-d66bee4ff1e1 req-b9188bbd-c3c0-4f3c-b564-85f0f5151415 service nova] Acquiring lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7a5c8ec1-7f2e-4241-a4d1-d66bee4ff1e1 req-b9188bbd-c3c0-4f3c-b564-85f0f5151415 service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7a5c8ec1-7f2e-4241-a4d1-d66bee4ff1e1 req-b9188bbd-c3c0-4f3c-b564-85f0f5151415 service nova] Lock "a77934ca-8e15-4158-9d25-cd20427d5b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-7a5c8ec1-7f2e-4241-a4d1-d66bee4ff1e1 req-b9188bbd-c3c0-4f3c-b564-85f0f5151415 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] No waiting events found dispatching network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:28:19 user nova-compute[75097]: WARNING nova.compute.manager [req-7a5c8ec1-7f2e-4241-a4d1-d66bee4ff1e1 req-b9188bbd-c3c0-4f3c-b564-85f0f5151415 service nova] [instance: a77934ca-8e15-4158-9d25-cd20427d5b07] Received unexpected event network-vif-plugged-1a9de883-33f2-4e14-8f36-702ceed50640 for instance with vm_state deleted and task_state None.
Nov 14 16:28:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:19 user nova-compute[75097]: INFO nova.compute.manager [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Detaching volume 8cd674a6-7d90-4dcd-bd7a-9e570f4a26df
Nov 14 16:28:19 user nova-compute[75097]: INFO nova.virt.block_device [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Attempting to driver detach volume 8cd674a6-7d90-4dcd-bd7a-9e570f4a26df from mountpoint /dev/vdb
Nov 14 16:28:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Attempting to detach device vdb from instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:28:19 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:28:19 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:28:19 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:28:19 user nova-compute[75097]:   <serial>8cd674a6-7d90-4dcd-bd7a-9e570f4a26df</serial>
Nov 14 16:28:19 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:28:19 user nova-compute[75097]: </disk>
Nov 14 16:28:19 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:28:19 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Successfully detached device vdb from instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 from the persistent domain config.
Nov 14 16:28:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:28:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:28:19 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:28:19 user nova-compute[75097]:   <source dev="/dev/sdd"/>
Nov 14 16:28:19 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:28:19 user nova-compute[75097]:   <serial>8cd674a6-7d90-4dcd-bd7a-9e570f4a26df</serial>
Nov 14 16:28:19 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:28:19 user nova-compute[75097]: </disk>
Nov 14 16:28:19 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:28:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:28:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:25 user nova-compute[75097]: INFO nova.compute.manager [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Terminating instance
Nov 14 16:28:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-23bcabf3-6683-4b13-a047-0eadb8861aac req-9a26e69e-acc0-4846-90aa-df8d7bd8ec30 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-vif-unplugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-23bcabf3-6683-4b13-a047-0eadb8861aac req-9a26e69e-acc0-4846-90aa-df8d7bd8ec30 service nova] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-23bcabf3-6683-4b13-a047-0eadb8861aac req-9a26e69e-acc0-4846-90aa-df8d7bd8ec30 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-23bcabf3-6683-4b13-a047-0eadb8861aac req-9a26e69e-acc0-4846-90aa-df8d7bd8ec30 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-23bcabf3-6683-4b13-a047-0eadb8861aac req-9a26e69e-acc0-4846-90aa-df8d7bd8ec30 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] No waiting events found dispatching network-vif-unplugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-23bcabf3-6683-4b13-a047-0eadb8861aac req-9a26e69e-acc0-4846-90aa-df8d7bd8ec30 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-vif-unplugged-026968fd-2db9-4659-8e81-faa34162666f for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:28:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Instance destroyed successfully.
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'resources' on Instance uuid 5a10a8dd-6ca4-4ada-aa74-e21278478d4f {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:19:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1420381695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1420381695',id=32,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-i3ke97y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:21:00Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=5a10a8dd-6ca4-4ada-aa74-e21278478d4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "026968fd-2db9-4659-8e81-faa34162666f", "address": "fa:16:3e:86:12:3e", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap026968fd-2d", "ovs_interfaceid": "026968fd-2db9-4659-8e81-faa34162666f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG os_vif [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap026968fd-2d, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=901d95b1-4246-4fb4-b6b0-bffdbea21abb) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: INFO os_vif [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:12:3e,bridge_name='br-int',has_traffic_filtering=True,id=026968fd-2db9-4659-8e81-faa34162666f,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap026968fd-2d')
Nov 14 16:28:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Deleting instance files /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f_del
Nov 14 16:28:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Deletion of /opt/stack/data/nova/instances/5a10a8dd-6ca4-4ada-aa74-e21278478d4f_del complete
Nov 14 16:28:26 user nova-compute[75097]: INFO nova.compute.manager [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 16:28:26 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:28:26 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Took 0.56 seconds to deallocate network for instance.
Nov 14 16:28:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:26 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:27 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Deleted allocations for instance 5a10a8dd-6ca4-4ada-aa74-e21278478d4f
Nov 14 16:28:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f826dca-4284-45cf-87de-c9d5d70730bb tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] Acquiring lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] Lock "5a10a8dd-6ca4-4ada-aa74-e21278478d4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] No waiting events found dispatching network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:28:27 user nova-compute[75097]: WARNING nova.compute.manager [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received unexpected event network-vif-plugged-026968fd-2db9-4659-8e81-faa34162666f for instance with vm_state deleted and task_state None.
Nov 14 16:28:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-7b9a1f9b-fcde-4002-8b5e-0c713cde7068 req-c67036fa-9389-4a58-83c0-7c2e57a54b61 service nova] [instance: 5a10a8dd-6ca4-4ada-aa74-e21278478d4f] Received event network-vif-deleted-026968fd-2db9-4659-8e81-faa34162666f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:28:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:40 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 is timed out.
Nov 14 16:28:40 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Successfully detached device vdb from instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 from the live domain config.
Nov 14 16:28:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNHyIdnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:28:40 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dfddbe-b0e1-4445-9345-33aa8556ead0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:28:40 user nova-compute[75097]: No targets found.
Nov 14 16:28:40 user nova-compute[75097]: iSNS:
Nov 14 16:28:40 user nova-compute[75097]: No targets found.
Nov 14 16:28:40 user nova-compute[75097]: STATIC:
Nov 14 16:28:40 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:28:40 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:28:40 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:28:40 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2
Nov 14 16:28:40 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:28:40 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:28:40 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df
Nov 14 16:28:40 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:28:40 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:28:40 user nova-compute[75097]: FIRMWARE:
Nov 14 16:28:40 user nova-compute[75097]: No targets found.
Nov 14 16:28:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:28:40 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:28:40 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef97045-03ec-4983-b9b2-b5864d86c1d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[74854647-b96b-40ce-b6c4-6e3ca81bc2cf]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:40 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:40 user nova-compute[75097]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df (non-flash)
Nov 14 16:28:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:28:40 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:28:40 user nova-compute[75097]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df (non-flash)
Nov 14 16:28:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9825de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df'): ({'sdd'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Removing single pathed devices sdd {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1106c-9f99-430a-8e94-28d600440640]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeab055-482c-417c-9e0a-b72f2063e7db]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Flushing IO for device /dev/sdd {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473589b-af92-4a6f-b1ee-bbc910731255]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8482e83-05de-4e9b-a1ef-ac86e72aa0c7]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] SCSI volumes sdd have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec15e2a7-3d9f-4450-aba0-23f79072a17d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4819e796-3bed-433d-a4e3-a6d407e627d1]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260]
Nov 14 16:28:40 user nova-compute[75097]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df, portal: 172.16.0.220,3260] successful.
Nov 14 16:28:40 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd674a6-7d90-4dcd-bd7a-9e570f4a26df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ac0664-3d4c-4e0d-ae7c-5e56f2609015]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] <== disconnect_volume: return (284ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:28:40 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:28:41 user nova-compute[75097]: DEBUG nova.objects.instance [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lazy-loading 'flavor' on Instance uuid 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:28:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7d2c8a13-7a6e-422d-acea-8630d57a6a0d tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:28:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:28:56 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:28:56 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:28:58 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:28:58 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8519MB free_disk=24.951133728027344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance f8d51b37-5f88-45f1-876b-99e387812c3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 20a52802-02e2-42df-aeae-63e5572d5564 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:28:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:29:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:12 user nova-compute[75097]: INFO nova.compute.manager [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Terminating instance
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-c0e6f14e-ec65-4bb1-887e-fc4d4612d03c req-98ca6426-0102-45d3-95b6-be508693c52c service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-unplugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c0e6f14e-ec65-4bb1-887e-fc4d4612d03c req-98ca6426-0102-45d3-95b6-be508693c52c service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c0e6f14e-ec65-4bb1-887e-fc4d4612d03c req-98ca6426-0102-45d3-95b6-be508693c52c service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c0e6f14e-ec65-4bb1-887e-fc4d4612d03c req-98ca6426-0102-45d3-95b6-be508693c52c service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-c0e6f14e-ec65-4bb1-887e-fc4d4612d03c req-98ca6426-0102-45d3-95b6-be508693c52c service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-unplugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-c0e6f14e-ec65-4bb1-887e-fc4d4612d03c req-98ca6426-0102-45d3-95b6-be508693c52c service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-unplugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Instance destroyed successfully.
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lazy-loading 'resources' on Instance uuid 0d9e69be-e34c-4e32-b10b-e628c4cd9b58 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:26:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-235954282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2359542',id=41,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgEX2JQf2G9RZsZezbu8m3ZDna6/wmERVTYWOnkAqW9Kq8NTc4sZwyd196yV4+qgGXRzO+NpM3bL2Lg4DlO71OfqC/LN4+yQ0tlwOx4EONWsXoBADnaR3JVpzjxvNUqQQ==',key_name='tempest-keypair-52197546',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:26:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c5eed0dd3da4aa9872bb394a5d771e8',ramdisk_id='',reservation_id='r-vbr3f9ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-668631944',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='743defe802c14f51aeff2032e10a7913',uuid=0d9e69be-e34c-4e32-b10b-e628c4cd9b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Converting VIF {"id": "0566f110-993a-426c-8a35-71bf4625d335", "address": "fa:16:3e:6a:dc:4b", "network": {"id": "c52dc61f-8efd-4c60-acce-e90e863fbed9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-649619628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5eed0dd3da4aa9872bb394a5d771e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0566f110-99", "ovs_interfaceid": "0566f110-993a-426c-8a35-71bf4625d335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG os_vif [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0566f110-99, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abdf68fa-3833-40e1-ab05-d0731069c926) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:12 user nova-compute[75097]: INFO os_vif [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=0566f110-993a-426c-8a35-71bf4625d335,network=Network(c52dc61f-8efd-4c60-acce-e90e863fbed9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0566f110-99')
Nov 14 16:29:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Deleting instance files /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58_del
Nov 14 16:29:12 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Deletion of /opt/stack/data/nova/instances/0d9e69be-e34c-4e32-b10b-e628c4cd9b58_del complete
Nov 14 16:29:12 user nova-compute[75097]: INFO nova.compute.manager [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 16:29:12 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:29:12 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:29:14 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Took 1.10 seconds to deallocate network for instance.
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:14 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Deleted allocations for instance 0d9e69be-e34c-4e32-b10b-e628c4cd9b58
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:14 user nova-compute[75097]: WARNING nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state deleted and task_state None.
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:14 user nova-compute[75097]: WARNING nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state deleted and task_state None.
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:14 user nova-compute[75097]: WARNING nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state deleted and task_state None.
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-unplugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-unplugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:14 user nova-compute[75097]: WARNING nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-unplugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state deleted and task_state None.
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Acquiring lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] No waiting events found dispatching network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:14 user nova-compute[75097]: WARNING nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received unexpected event network-vif-plugged-0566f110-993a-426c-8a35-71bf4625d335 for instance with vm_state deleted and task_state None.
Nov 14 16:29:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e4f569c-8910-4555-b3af-cdd70137a934 req-51d1e67e-fa00-406d-bb0a-06ca6b9db73b service nova] [instance: 0d9e69be-e34c-4e32-b10b-e628c4cd9b58] Received event network-vif-deleted-0566f110-993a-426c-8a35-71bf4625d335 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ebfdc48d-7fdc-4c5e-a948-4aba9aff58b6 tempest-TestServerVolumeAttachScenarioOldVersion-668631944 tempest-TestServerVolumeAttachScenarioOldVersion-668631944-project-member] Lock "0d9e69be-e34c-4e32-b10b-e628c4cd9b58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.392s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:15 user nova-compute[75097]: INFO nova.compute.manager [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Terminating instance
Nov 14 16:29:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcb2c1ff-59a8-42af-865b-e26992e7031a req-576ae0cd-18cb-4fb7-aa1f-b4f1aab884cd service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcb2c1ff-59a8-42af-865b-e26992e7031a req-576ae0cd-18cb-4fb7-aa1f-b4f1aab884cd service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcb2c1ff-59a8-42af-865b-e26992e7031a req-576ae0cd-18cb-4fb7-aa1f-b4f1aab884cd service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bcb2c1ff-59a8-42af-865b-e26992e7031a req-576ae0cd-18cb-4fb7-aa1f-b4f1aab884cd service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcb2c1ff-59a8-42af-865b-e26992e7031a req-576ae0cd-18cb-4fb7-aa1f-b4f1aab884cd service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-bcb2c1ff-59a8-42af-865b-e26992e7031a req-576ae0cd-18cb-4fb7-aa1f-b4f1aab884cd service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-unplugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:29:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Instance destroyed successfully.
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.objects.instance [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'resources' on Instance uuid f8d51b37-5f88-45f1-876b-99e387812c3c {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1215259689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1215259689',id=28,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-bf08lva9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:17:16Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=f8d51b37-5f88-45f1-876b-99e387812c3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "address": "fa:16:3e:0f:90:a8", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db5225e-74", "ovs_interfaceid": "1db5225e-74ac-45ff-af6a-74ba19fbcfe9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_vif [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db5225e-74, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84346c36-580c-4ed0-9387-3154a023165b) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:29:16 user nova-compute[75097]: INFO os_vif [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:a8,bridge_name='br-int',has_traffic_filtering=True,id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db5225e-74')
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oJqzrPZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:29:16 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9036c0b3-df7a-424d-8883-b3f6979a036d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:29:16 user nova-compute[75097]: No targets found.
Nov 14 16:29:16 user nova-compute[75097]: iSNS:
Nov 14 16:29:16 user nova-compute[75097]: No targets found.
Nov 14 16:29:16 user nova-compute[75097]: STATIC:
Nov 14 16:29:16 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73
Nov 14 16:29:16 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:29:16 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:29:16 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2
Nov 14 16:29:16 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:29:16 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:29:16 user nova-compute[75097]: FIRMWARE:
Nov 14 16:29:16 user nova-compute[75097]: No targets found.
Nov 14 16:29:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:29:16 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:29:16 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f7460-0563-4c9c-b5a2-80614bc3f911]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcebe8d-949b-459d-96c2-a70014fa5b64]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:29:16 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:29:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 (non-flash)
Nov 14 16:29:16 user nova-compute[75097]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:29:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafb8364820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8986fec8-3e03-435f-a15c-975638b29def]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b95745d-7c2c-4b9d-90de-eb9214a73665]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950c5f7-7e11-4ed6-aa00-9c5616d9925a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[768d7f2f-6ae4-4f0e-b802-8f4bf4d2542e]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0795c6d-45b2-45e2-8830-00cadeae9c6f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca6158-9c33-488d-a7ed-db399db41874]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260]
Nov 14 16:29:16 user nova-compute[75097]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73, portal: 172.16.0.220,3260] successful.
Nov 14 16:29:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbabaed-6d22-46f9-9649-e87681a00f73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b00e07-3931-4990-a00a-16b78f68de62]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] <== disconnect_volume: return (295ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:29:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Deleting instance files /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c_del
Nov 14 16:29:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Deletion of /opt/stack/data/nova/instances/f8d51b37-5f88-45f1-876b-99e387812c3c_del complete
Nov 14 16:29:16 user nova-compute[75097]: INFO nova.compute.manager [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 16:29:16 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:29:16 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:29:17 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:29:17 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Took 0.45 seconds to deallocate network for instance.
Nov 14 16:29:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-058854a4-e5bb-49d5-b5f8-3ce3e0b4cb31 req-01ae0706-7f08-41db-93fd-6051f9c3f487 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-deleted-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:17 user nova-compute[75097]: INFO nova.compute.manager [req-058854a4-e5bb-49d5-b5f8-3ce3e0b4cb31 req-01ae0706-7f08-41db-93fd-6051f9c3f487 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Neutron deleted interface 1db5225e-74ac-45ff-af6a-74ba19fbcfe9; detaching it from the instance and deleting it from the info cache
Nov 14 16:29:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-058854a4-e5bb-49d5-b5f8-3ce3e0b4cb31 req-01ae0706-7f08-41db-93fd-6051f9c3f487 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:29:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-058854a4-e5bb-49d5-b5f8-3ce3e0b4cb31 req-01ae0706-7f08-41db-93fd-6051f9c3f487 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Detach interface failed, port_id=1db5225e-74ac-45ff-af6a-74ba19fbcfe9, reason: Instance f8d51b37-5f88-45f1-876b-99e387812c3c could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:29:17 user nova-compute[75097]: INFO nova.compute.manager [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 16:29:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:18 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Deleted allocations for instance f8d51b37-5f88-45f1-876b-99e387812c3c
Nov 14 16:29:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-bb4fc6e3-acef-4ee1-8801-53b587f273cc req-a1ad979d-bb8b-4dd4-a454-47c24d3c2a49 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bb4fc6e3-acef-4ee1-8801-53b587f273cc req-a1ad979d-bb8b-4dd4-a454-47c24d3c2a49 service nova] Acquiring lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bb4fc6e3-acef-4ee1-8801-53b587f273cc req-a1ad979d-bb8b-4dd4-a454-47c24d3c2a49 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bb4fc6e3-acef-4ee1-8801-53b587f273cc req-a1ad979d-bb8b-4dd4-a454-47c24d3c2a49 service nova] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:18 user nova-compute[75097]: DEBUG nova.compute.manager [req-bb4fc6e3-acef-4ee1-8801-53b587f273cc req-a1ad979d-bb8b-4dd4-a454-47c24d3c2a49 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] No waiting events found dispatching network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:18 user nova-compute[75097]: WARNING nova.compute.manager [req-bb4fc6e3-acef-4ee1-8801-53b587f273cc req-a1ad979d-bb8b-4dd4-a454-47c24d3c2a49 service nova] [instance: f8d51b37-5f88-45f1-876b-99e387812c3c] Received unexpected event network-vif-plugged-1db5225e-74ac-45ff-af6a-74ba19fbcfe9 for instance with vm_state deleted and task_state None.
Nov 14 16:29:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-65f30a37-6c4c-46c8-80ca-bf18e32b263d tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "f8d51b37-5f88-45f1-876b-99e387812c3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:42 user nova-compute[75097]: INFO nova.compute.manager [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Unshelving
Nov 14 16:29:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'pci_requests' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:29:42 user nova-compute[75097]: INFO nova.compute.claims [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Claim successful on node user
Nov 14 16:29:42 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:29:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:42 user nova-compute[75097]: INFO nova.network.neutron [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating port 38115c8f-855f-478e-9ca6-5066d79321af with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-changed-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.compute.manager [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing instance network info cache due to event network-changed-38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] Acquiring lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.network.neutron [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:29:43 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Creating image(s)
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] Acquired lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.network.neutron [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Refreshing network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG nova.objects.base [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<8cf8cc4f-96f4-487a-8739-1fbedfd2d428> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "2de4265d5d3de0453a13e4042b3e19a972a111fb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:43 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "2de4265d5d3de0453a13e4042b3e19a972a111fb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.part --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:44 user nova-compute[75097]: DEBUG nova.virt.images [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] 70622b30-818c-4a49-8650-a86b4ee519f6 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:29:44 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:29:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.part /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.part /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.converted" returned: 0 in 0.492s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updated VIF entry in instance network info cache for port 38115c8f-855f-478e-9ca6-5066d79321af. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG nova.network.neutron [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1e7e5f7-a3f0-4156-b32c-c01db78b765c req-5a2965ae-eaac-4282-bc29-a8e560917fa8 service nova] Releasing lock "refresh_cache-8cf8cc4f-96f4-487a-8739-1fbedfd2d428" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "2de4265d5d3de0453a13e4042b3e19a972a111fb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.786s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "2de4265d5d3de0453a13e4042b3e19a972a111fb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "2de4265d5d3de0453a13e4042b3e19a972a111fb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb,backing_fmt=raw /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb,backing_fmt=raw /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk 1073741824" returned: 0 in 0.046s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "2de4265d5d3de0453a13e4042b3e19a972a111fb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'migration_context' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:45 user nova-compute[75097]: DEBUG nova.objects.base [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<8cf8cc4f-96f4-487a-8739-1fbedfd2d428> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:29:45 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Rebasing disk image.
Nov 14 16:29:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:46 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee -F raw /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee -F raw /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk" returned: 0 in 2.052s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Ensure instance console log exists: /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Start _get_guest_xml network_info=[{"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='51edf13018731f97491fabe0b427f329',container_format='bare',created_at=2023-11-14T16:27:49Z,direct_url=<?>,disk_format='qcow2',id=70622b30-818c-4a49-8650-a86b4ee519f6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1794728049-shelved',owner='b644535e1a5b431e830a9d0aa10294e3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T16:27:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:29:48 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:29:48 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='51edf13018731f97491fabe0b427f329',container_format='bare',created_at=2023-11-14T16:27:49Z,direct_url=<?>,disk_format='qcow2',id=70622b30-818c-4a49-8650-a86b4ee519f6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1794728049-shelved',owner='b644535e1a5b431e830a9d0aa10294e3',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T16:27:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.objects.base [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<8cf8cc4f-96f4-487a-8739-1fbedfd2d428> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1794728049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1794728049',id=40,image_ref='70622b30-818c-4a49-8650-a86b4ee519f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1203540656',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:26:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-s23mde0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member',shelved_at='2023-11-14T16:27:53.059528',shelved_host='user',shelved_image_id='70622b30-818c-4a49-8650-a86b4ee519f6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=8cf8cc4f-96f4-487a-8739-1fbedfd2d428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.objects.base [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Object Instance<8cf8cc4f-96f4-487a-8739-1fbedfd2d428> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:29:48 user nova-compute[75097]:   <uuid>8cf8cc4f-96f4-487a-8739-1fbedfd2d428</uuid>
Nov 14 16:29:48 user nova-compute[75097]:   <name>instance-00000028</name>
Nov 14 16:29:48 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:29:48 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:29:48 user nova-compute[75097]:   <metadata>
Nov 14 16:29:48 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:29:48 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:29:48 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1794728049</nova:name>
Nov 14 16:29:48 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:29:48</nova:creationTime>
Nov 14 16:29:48 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:29:48 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:29:48 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:29:48 user nova-compute[75097]:       <nova:owner>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:user uuid="eff36d66033f4331aa582c9fd2eab626">tempest-AttachVolumeShelveTestJSON-347532404-project-member</nova:user>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:project uuid="b644535e1a5b431e830a9d0aa10294e3">tempest-AttachVolumeShelveTestJSON-347532404</nova:project>
Nov 14 16:29:48 user nova-compute[75097]:       </nova:owner>
Nov 14 16:29:48 user nova-compute[75097]:       <nova:root type="image" uuid="70622b30-818c-4a49-8650-a86b4ee519f6"/>
Nov 14 16:29:48 user nova-compute[75097]:       <nova:ports>
Nov 14 16:29:48 user nova-compute[75097]:         <nova:port uuid="38115c8f-855f-478e-9ca6-5066d79321af">
Nov 14 16:29:48 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 16:29:48 user nova-compute[75097]:         </nova:port>
Nov 14 16:29:48 user nova-compute[75097]:       </nova:ports>
Nov 14 16:29:48 user nova-compute[75097]:     </nova:instance>
Nov 14 16:29:48 user nova-compute[75097]:   </metadata>
Nov 14 16:29:48 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:29:48 user nova-compute[75097]:     <system>
Nov 14 16:29:48 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:29:48 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:29:48 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:29:48 user nova-compute[75097]:       <entry name="serial">8cf8cc4f-96f4-487a-8739-1fbedfd2d428</entry>
Nov 14 16:29:48 user nova-compute[75097]:       <entry name="uuid">8cf8cc4f-96f4-487a-8739-1fbedfd2d428</entry>
Nov 14 16:29:48 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:29:48 user nova-compute[75097]:     </system>
Nov 14 16:29:48 user nova-compute[75097]:   </sysinfo>
Nov 14 16:29:48 user nova-compute[75097]:   <os>
Nov 14 16:29:48 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:29:48 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:29:48 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:29:48 user nova-compute[75097]:   </os>
Nov 14 16:29:48 user nova-compute[75097]:   <features>
Nov 14 16:29:48 user nova-compute[75097]:     <acpi/>
Nov 14 16:29:48 user nova-compute[75097]:     <apic/>
Nov 14 16:29:48 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:29:48 user nova-compute[75097]:   </features>
Nov 14 16:29:48 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:29:48 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:29:48 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:29:48 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:29:48 user nova-compute[75097]:   </clock>
Nov 14 16:29:48 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:29:48 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:29:48 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:29:48 user nova-compute[75097]:   </cpu>
Nov 14 16:29:48 user nova-compute[75097]:   <devices>
Nov 14 16:29:48 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:29:48 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:29:48 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk"/>
Nov 14 16:29:48 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:29:48 user nova-compute[75097]:     </disk>
Nov 14 16:29:48 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:29:48 user nova-compute[75097]:       <mac address="fa:16:3e:83:c3:b7"/>
Nov 14 16:29:48 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:29:48 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:29:48 user nova-compute[75097]:       <target dev="tap38115c8f-85"/>
Nov 14 16:29:48 user nova-compute[75097]:     </interface>
Nov 14 16:29:48 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:29:48 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/console.log" append="off"/>
Nov 14 16:29:48 user nova-compute[75097]:     </serial>
Nov 14 16:29:48 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:29:48 user nova-compute[75097]:     <video>
Nov 14 16:29:48 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:29:48 user nova-compute[75097]:     </video>
Nov 14 16:29:48 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:29:48 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:29:48 user nova-compute[75097]:     </rng>
Nov 14 16:29:48 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:29:48 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:29:48 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:29:48 user nova-compute[75097]:     </memballoon>
Nov 14 16:29:48 user nova-compute[75097]:   </devices>
Nov 14 16:29:48 user nova-compute[75097]: </domain>
Nov 14 16:29:48 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1794728049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1794728049',id=40,image_ref='70622b30-818c-4a49-8650-a86b4ee519f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1203540656',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:26:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-s23mde0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member',shelved_at='2023-11-14T16:27:53.059528',shelved_host='user',shelved_image_id='70622b30-818c-4a49-8650-a86b4ee519f6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=8cf8cc4f-96f4-487a-8739-1fbedfd2d428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG os_vif [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bda3d877-1627-568d-b3e2-7f52e3b20edf', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38115c8f-85, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38115c8f-85, col_values=(('qos', UUID('30b05013-8250-40eb-9921-3d786acacd8b')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38115c8f-85, col_values=(('external_ids', {'iface-id': '38115c8f-855f-478e-9ca6-5066d79321af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c3:b7', 'vm-uuid': '8cf8cc4f-96f4-487a-8739-1fbedfd2d428'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:48 user nova-compute[75097]: INFO os_vif [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85')
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:29:48 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] No VIF found with MAC fa:16:3e:83:c3:b7, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-64bbc29a-bb08-43ce-8b18-085acf182952 req-2a891ae5-a470-40c7-bd5e-bb2133ca5e68 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-64bbc29a-bb08-43ce-8b18-085acf182952 req-2a891ae5-a470-40c7-bd5e-bb2133ca5e68 service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-64bbc29a-bb08-43ce-8b18-085acf182952 req-2a891ae5-a470-40c7-bd5e-bb2133ca5e68 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-64bbc29a-bb08-43ce-8b18-085acf182952 req-2a891ae5-a470-40c7-bd5e-bb2133ca5e68 service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-64bbc29a-bb08-43ce-8b18-085acf182952 req-2a891ae5-a470-40c7-bd5e-bb2133ca5e68 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:49 user nova-compute[75097]: WARNING nova.compute.manager [req-64bbc29a-bb08-43ce-8b18-085acf182952 req-2a891ae5-a470-40c7-bd5e-bb2133ca5e68 service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 16:29:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:29:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance spawned successfully.
Nov 14 16:29:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-25b90f85-9d78-4e1b-a267-e5a96e8b6527 req-9a7550d0-0bd9-4391-bd22-3868e7b9aa2b service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-25b90f85-9d78-4e1b-a267-e5a96e8b6527 req-9a7550d0-0bd9-4391-bd22-3868e7b9aa2b service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-25b90f85-9d78-4e1b-a267-e5a96e8b6527 req-9a7550d0-0bd9-4391-bd22-3868e7b9aa2b service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-25b90f85-9d78-4e1b-a267-e5a96e8b6527 req-9a7550d0-0bd9-4391-bd22-3868e7b9aa2b service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-25b90f85-9d78-4e1b-a267-e5a96e8b6527 req-9a7550d0-0bd9-4391-bd22-3868e7b9aa2b service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:29:51 user nova-compute[75097]: WARNING nova.compute.manager [req-25b90f85-9d78-4e1b-a267-e5a96e8b6527 req-9a7550d0-0bd9-4391-bd22-3868e7b9aa2b service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 16:29:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f891a2d4-b382-42e9-a8c7-6f24c78cb0ac tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.860s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-changed-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Refreshing instance network info cache due to event network-changed-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] Acquiring lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] Acquired lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Refreshing network info cache for port 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updated VIF entry in instance network info cache for port 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG nova.network.neutron [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating instance_info_cache with network_info: [{"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:29:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-173aa1a1-8fe0-42b7-9f4e-4b9cba523411 req-198a47df-aff6-4dd1-82fc-18613f705efb service nova] Releasing lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:29:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:29:58 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:29:58 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8664MB free_disk=24.95163345336914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 20a52802-02e2-42df-aeae-63e5572d5564 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "db271845-0b08-4019-b7c3-92c900997d15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:29:58 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:29:58 user nova-compute[75097]: INFO nova.compute.claims [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Claim successful on node user
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:29:59 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.policy [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc348d16cb0415fbbb357b7f030798e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea103d756c514917ae4aeb70b70b9097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:29:59 user nova-compute[75097]: INFO nova.virt.block_device [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Booting with volume snapshot 1cb43d2a-cff3-429c-a650-3de7ea582861 at /dev/vda
Nov 14 16:29:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: db271845-0b08-4019-b7c3-92c900997d15] Skipping network cache update for instance because it is Building. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:29:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Successfully created port: 9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [{"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-099ba580-8e81-42ac-864c-8a76a6b8f2c5" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Successfully updated port: 9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquired lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-changed-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Refreshing instance network info cache due to event network-changed-9a21acae-db8c-4ca3-b94f-0702c36d01a3. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] Acquiring lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:30:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG nova.network.neutron [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updating instance_info_cache with network_info: [{"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Releasing lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Instance network_info: |[{"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] Acquired lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Refreshing network info cache for port 9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updated VIF entry in instance network info cache for port 9a21acae-db8c-4ca3-b94f-0702c36d01a3. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updating instance_info_cache with network_info: [{"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:30:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b8bb8fda-438f-4044-9ea8-a7f3cce6e833 req-f0e98141-ee95-4f3e-b735-a80ab088d983 service nova] Releasing lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:30:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG os_brick.utils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ffe9de-b649-4df0-8cc9-ad7443f820a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef2ede-4226-40a6-9794-09d244cf1dbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c702f-0169-4d63-9d4e-9a83e5816cf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df03744-e9db-4597-a44b-ebff79b840df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:30:05 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:30:05 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43e2419-742a-4c05-8ca6-4d784edd5ed4]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG os_brick.utils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:30:05 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updating existing volume attachment record: 2363836e-3f30-4cd1-99cb-e5e12e5724f6 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:06 user nova-compute[75097]: INFO nova.compute.manager [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Terminating instance
Nov 14 16:30:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-b88fdd1c-818b-42ae-80e8-7fbd3f56da64 req-8e070b3d-8fd3-4bf8-9948-c494f4754899 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-vif-unplugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b88fdd1c-818b-42ae-80e8-7fbd3f56da64 req-8e070b3d-8fd3-4bf8-9948-c494f4754899 service nova] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b88fdd1c-818b-42ae-80e8-7fbd3f56da64 req-8e070b3d-8fd3-4bf8-9948-c494f4754899 service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b88fdd1c-818b-42ae-80e8-7fbd3f56da64 req-8e070b3d-8fd3-4bf8-9948-c494f4754899 service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-b88fdd1c-818b-42ae-80e8-7fbd3f56da64 req-8e070b3d-8fd3-4bf8-9948-c494f4754899 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] No waiting events found dispatching network-vif-unplugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-b88fdd1c-818b-42ae-80e8-7fbd3f56da64 req-8e070b3d-8fd3-4bf8-9948-c494f4754899 service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-vif-unplugged-0f080448-9ce2-4659-8d19-683e6eec2c53 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:07 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Instance destroyed successfully.
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lazy-loading 'resources' on Instance uuid 099ba580-8e81-42ac-864c-8a76a6b8f2c5 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-853240297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-853240297',id=25,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:10:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aefeb20cd07a41f09d0c4e19e99518f0',ramdisk_id='',reservation_id='r-ov4cnkg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:12:28Z,user_data=None,user_id='b4bb999bbbcf4d4c9058ea6921655732',uuid=099ba580-8e81-42ac-864c-8a76a6b8f2c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converting VIF {"id": "0f080448-9ce2-4659-8d19-683e6eec2c53", "address": "fa:16:3e:ad:7b:5b", "network": {"id": "e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1491375263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aefeb20cd07a41f09d0c4e19e99518f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f080448-9c", "ovs_interfaceid": "0f080448-9ce2-4659-8d19-683e6eec2c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG os_vif [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f080448-9c, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=049509fa-a8a4-4f17-9120-ff59bfd0a2b3) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:30:07 user nova-compute[75097]: INFO os_vif [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=0f080448-9ce2-4659-8d19-683e6eec2c53,network=Network(e5a249bf-072f-4f28-8ef3-dc59bfd9fbe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f080448-9c')
Nov 14 16:30:07 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Deleting instance files /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5_del
Nov 14 16:30:07 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Deletion of /opt/stack/data/nova/instances/099ba580-8e81-42ac-864c-8a76a6b8f2c5_del complete
Nov 14 16:30:07 user nova-compute[75097]: INFO nova.compute.manager [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 16:30:07 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:30:07 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:30:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:08 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:30:08 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Took 0.71 seconds to deallocate network for instance.
Nov 14 16:30:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:08 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:30:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:30:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:08 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Deleted allocations for instance 099ba580-8e81-42ac-864c-8a76a6b8f2c5
Nov 14 16:30:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f6e9848f-3ccd-4f42-a744-55a1f7d1e301 tempest-ServerBootFromVolumeStableRescueTest-1745607452 tempest-ServerBootFromVolumeStableRescueTest-1745607452-project-member] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.972s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:30:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] Acquiring lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] Lock "099ba580-8e81-42ac-864c-8a76a6b8f2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] No waiting events found dispatching network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:30:09 user nova-compute[75097]: WARNING nova.compute.manager [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received unexpected event network-vif-plugged-0f080448-9ce2-4659-8d19-683e6eec2c53 for instance with vm_state deleted and task_state None.
Nov 14 16:30:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-41bba50f-10ae-4c99-b36c-a249e44d1c2b req-d89c824c-a31a-40dc-9af9-ca66ee94575d service nova] [instance: 099ba580-8e81-42ac-864c-8a76a6b8f2c5] Received event network-vif-deleted-0f080448-9ce2-4659-8d19-683e6eec2c53 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:30:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:30:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Creating image(s)
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Ensure instance console log exists: /opt/stack/data/nova/instances/db271845-0b08-4019-b7c3-92c900997d15/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Start _get_guest_xml network_info=[{"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T16:29:55Z,direct_url=<?>,disk_format='qcow2',id=2d8e2d2c-fe6d-46e2-a04d-9746ffd9fe02,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1494170131',owner='ea103d756c514917ae4aeb70b70b9097',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T16:29:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdKNYrxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db271845-0b08-4019-b7c3-92c900997d15', 'attached_at': '', 'detached_at': '', 'volume_id': '170d2282-719e-441c-95ff-097283b2a173', 'serial': '170d2282-719e-441c-95ff-097283b2a173'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '2363836e-3f30-4cd1-99cb-e5e12e5724f6', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:30:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:30:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T16:29:55Z,direct_url=<?>,disk_format='qcow2',id=2d8e2d2c-fe6d-46e2-a04d-9746ffd9fe02,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1494170131',owner='ea103d756c514917ae4aeb70b70b9097',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T16:29:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdKNYrxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:30:10 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:30:10 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:30:10 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ee86a-2586-4304-8fe1-21e8b22dc170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:30:10 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8be4f-0215-4968-894a-6f1eda82168d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173] added
Nov 14 16:30:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.126s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c85732-efc1-447d-9180-e4a24f82cf7e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bc148a-0cb1-494a-bba3-d6da62d08fc9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdKNYrxz {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdKNYrxz" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0646ab1d-1854-47ce-b7dd-c772929a7a50]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdKNYrxz'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9e65a1-8e36-454d-9be4-0417d955ad8a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6a2d11-2fbd-4f59-aab3-183d7e36d7ac]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:30:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:30:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[231db446-21ec-4b64-b8ae-4c5aa8755ca6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260]
Nov 14 16:30:10 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260] successful.
Nov 14 16:30:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[324ec970-c2dc-40c2-9189-078d2823ac2f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96d248-f30a-46bc-872b-d5b7f3c0a46f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:30:10 user nova-compute[75097]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 (non-flash)
Nov 14 16:30:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:30:10 user nova-compute[75097]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 (non-flash)
Nov 14 16:30:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.143s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487675e-5dbf-4ae6-88a4-b545f4f530c2]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:30:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdKNYrxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.526s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== connect_volume: return (1529ms) {'type': 'block', 'scsi_wwn': '23736373735333632', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736373735333632', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1835082309',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1835082309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1835082309',id=43,image_ref='2d8e2d2c-fe6d-46e2-a04d-9746ffd9fe02',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnfn1Sj8tumVUACi7yRiOd6Qg/M+Wd/Sb0hEI9VdpTOPg7osroKyan9uHgJi2Qtv9KJKC1hMfh345+l7mBcnqzkGExOwS2XNcSriHx49C93hb67LhK6qmVGREK2Y65qVg==',key_name='tempest-keypair-704691426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-zbe94j6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1353533810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=db271845-0b08-4019-b7c3-92c900997d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.objects.instance [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'pci_devices' on Instance uuid db271845-0b08-4019-b7c3-92c900997d15 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:30:11 user nova-compute[75097]:   <uuid>db271845-0b08-4019-b7c3-92c900997d15</uuid>
Nov 14 16:30:11 user nova-compute[75097]:   <name>instance-0000002b</name>
Nov 14 16:30:11 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:30:11 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:30:11 user nova-compute[75097]:   <metadata>
Nov 14 16:30:11 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:30:11 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:30:11 user nova-compute[75097]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1835082309</nova:name>
Nov 14 16:30:11 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:30:10</nova:creationTime>
Nov 14 16:30:11 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:30:11 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:30:11 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:30:11 user nova-compute[75097]:       <nova:owner>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:user uuid="7dc348d16cb0415fbbb357b7f030798e">tempest-TestVolumeBootPattern-1353533810-project-member</nova:user>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:project uuid="ea103d756c514917ae4aeb70b70b9097">tempest-TestVolumeBootPattern-1353533810</nova:project>
Nov 14 16:30:11 user nova-compute[75097]:       </nova:owner>
Nov 14 16:30:11 user nova-compute[75097]:       <nova:root type="image" uuid="2d8e2d2c-fe6d-46e2-a04d-9746ffd9fe02"/>
Nov 14 16:30:11 user nova-compute[75097]:       <nova:ports>
Nov 14 16:30:11 user nova-compute[75097]:         <nova:port uuid="9a21acae-db8c-4ca3-b94f-0702c36d01a3">
Nov 14 16:30:11 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 16:30:11 user nova-compute[75097]:         </nova:port>
Nov 14 16:30:11 user nova-compute[75097]:       </nova:ports>
Nov 14 16:30:11 user nova-compute[75097]:     </nova:instance>
Nov 14 16:30:11 user nova-compute[75097]:   </metadata>
Nov 14 16:30:11 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:30:11 user nova-compute[75097]:     <system>
Nov 14 16:30:11 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:30:11 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:30:11 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:30:11 user nova-compute[75097]:       <entry name="serial">db271845-0b08-4019-b7c3-92c900997d15</entry>
Nov 14 16:30:11 user nova-compute[75097]:       <entry name="uuid">db271845-0b08-4019-b7c3-92c900997d15</entry>
Nov 14 16:30:11 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:30:11 user nova-compute[75097]:     </system>
Nov 14 16:30:11 user nova-compute[75097]:   </sysinfo>
Nov 14 16:30:11 user nova-compute[75097]:   <os>
Nov 14 16:30:11 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:30:11 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:30:11 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:30:11 user nova-compute[75097]:   </os>
Nov 14 16:30:11 user nova-compute[75097]:   <features>
Nov 14 16:30:11 user nova-compute[75097]:     <acpi/>
Nov 14 16:30:11 user nova-compute[75097]:     <apic/>
Nov 14 16:30:11 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:30:11 user nova-compute[75097]:   </features>
Nov 14 16:30:11 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:30:11 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:30:11 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:30:11 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:30:11 user nova-compute[75097]:   </clock>
Nov 14 16:30:11 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:30:11 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:30:11 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:30:11 user nova-compute[75097]:   </cpu>
Nov 14 16:30:11 user nova-compute[75097]:   <devices>
Nov 14 16:30:11 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:30:11 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:30:11 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:30:11 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:30:11 user nova-compute[75097]:       <serial>170d2282-719e-441c-95ff-097283b2a173</serial>
Nov 14 16:30:11 user nova-compute[75097]:     </disk>
Nov 14 16:30:11 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:30:11 user nova-compute[75097]:       <mac address="fa:16:3e:54:3e:39"/>
Nov 14 16:30:11 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:30:11 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:30:11 user nova-compute[75097]:       <target dev="tap9a21acae-db"/>
Nov 14 16:30:11 user nova-compute[75097]:     </interface>
Nov 14 16:30:11 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:30:11 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/db271845-0b08-4019-b7c3-92c900997d15/console.log" append="off"/>
Nov 14 16:30:11 user nova-compute[75097]:     </serial>
Nov 14 16:30:11 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:30:11 user nova-compute[75097]:     <video>
Nov 14 16:30:11 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:30:11 user nova-compute[75097]:     </video>
Nov 14 16:30:11 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:30:11 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:30:11 user nova-compute[75097]:     </rng>
Nov 14 16:30:11 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:30:11 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:30:11 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:30:11 user nova-compute[75097]:     </memballoon>
Nov 14 16:30:11 user nova-compute[75097]:   </devices>
Nov 14 16:30:11 user nova-compute[75097]: </domain>
Nov 14 16:30:11 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1835082309',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1835082309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1835082309',id=43,image_ref='2d8e2d2c-fe6d-46e2-a04d-9746ffd9fe02',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnfn1Sj8tumVUACi7yRiOd6Qg/M+Wd/Sb0hEI9VdpTOPg7osroKyan9uHgJi2Qtv9KJKC1hMfh345+l7mBcnqzkGExOwS2XNcSriHx49C93hb67LhK6qmVGREK2Y65qVg==',key_name='tempest-keypair-704691426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-zbe94j6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1353533810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=db271845-0b08-4019-b7c3-92c900997d15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG os_vif [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5d69ba1-f557-5470-b963-597a56c14758', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a21acae-db, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a21acae-db, col_values=(('qos', UUID('a816b223-ee2b-496f-8bfe-6c21fe6b7605')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a21acae-db, col_values=(('external_ids', {'iface-id': '9a21acae-db8c-4ca3-b94f-0702c36d01a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:3e:39', 'vm-uuid': 'db271845-0b08-4019-b7c3-92c900997d15'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:11 user nova-compute[75097]: INFO os_vif [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db')
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:30:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No VIF found with MAC fa:16:3e:54:3e:39, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:30:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-51267f12-781c-40e2-a7bd-731cd6901eda req-d6e7db0a-ef0a-4e68-8864-b84c724d213c service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51267f12-781c-40e2-a7bd-731cd6901eda req-d6e7db0a-ef0a-4e68-8864-b84c724d213c service nova] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51267f12-781c-40e2-a7bd-731cd6901eda req-d6e7db0a-ef0a-4e68-8864-b84c724d213c service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-51267f12-781c-40e2-a7bd-731cd6901eda req-d6e7db0a-ef0a-4e68-8864-b84c724d213c service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-51267f12-781c-40e2-a7bd-731cd6901eda req-d6e7db0a-ef0a-4e68-8864-b84c724d213c service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] No waiting events found dispatching network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:30:13 user nova-compute[75097]: WARNING nova.compute.manager [req-51267f12-781c-40e2-a7bd-731cd6901eda req-d6e7db0a-ef0a-4e68-8864-b84c724d213c service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received unexpected event network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 for instance with vm_state building and task_state spawning.
Nov 14 16:30:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:30:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: db271845-0b08-4019-b7c3-92c900997d15] Instance spawned successfully.
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:30:15 user nova-compute[75097]: INFO nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:30:15 user nova-compute[75097]: INFO nova.compute.manager [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Took 16.40 seconds to build instance.
Nov 14 16:30:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-acc03cc1-4570-42cc-80db-1de8a1997bdf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "db271845-0b08-4019-b7c3-92c900997d15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.493s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-c3eefe00-bc0e-4ba8-bdc8-d331b2e5df75 req-324ec0ae-05bc-4c4c-ac92-c1450ab02340 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c3eefe00-bc0e-4ba8-bdc8-d331b2e5df75 req-324ec0ae-05bc-4c4c-ac92-c1450ab02340 service nova] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c3eefe00-bc0e-4ba8-bdc8-d331b2e5df75 req-324ec0ae-05bc-4c4c-ac92-c1450ab02340 service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-c3eefe00-bc0e-4ba8-bdc8-d331b2e5df75 req-324ec0ae-05bc-4c4c-ac92-c1450ab02340 service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-c3eefe00-bc0e-4ba8-bdc8-d331b2e5df75 req-324ec0ae-05bc-4c4c-ac92-c1450ab02340 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] No waiting events found dispatching network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:30:15 user nova-compute[75097]: WARNING nova.compute.manager [req-c3eefe00-bc0e-4ba8-bdc8-d331b2e5df75 req-324ec0ae-05bc-4c4c-ac92-c1450ab02340 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received unexpected event network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 for instance with vm_state active and task_state None.
Nov 14 16:30:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:30:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:30:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:30:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:30:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:30:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:30:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:30:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.066421508789062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 20a52802-02e2-42df-aeae-63e5572d5564 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance db271845-0b08-4019-b7c3-92c900997d15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:30:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:31:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:31:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:31:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:31:01 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating instance_info_cache with network_info: [{"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:31:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-20a52802-02e2-42df-aeae-63e5572d5564" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:31:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:31:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:31:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:06 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:31:09 user nova-compute[75097]: INFO nova.compute.claims [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Claim successful on node user
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:31:09 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:31:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.policy [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2cfd76997bb4634b509c13a32c29d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dcba30fbc34d668cd3d26220a2d5a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:31:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Creating image(s)
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk 1073741824" returned: 0 in 0.057s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Successfully created port: c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Cannot resize image /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Ensure instance console log exists: /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Successfully updated port: c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing instance network info cache due to event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance network_info: |[{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Start _get_guest_xml network_info=[{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:31:11 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:31:11 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1235024558',display_name='tempest-ServerStableDeviceRescueTest-server-1235024558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1235024558',id=44,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzpTQLF/M4onCQrFMnOECKDng5gDhjER0ofgkjAyno5iri9RVa+DUBa3/HZrwQ9rYjPuAyHnI3rTEiDLYmoUajtjAF7IvvVJr1AV7x1/GOTEh2DSwxz1aM0P/qg9oKhhA==',key_name='tempest-keypair-43856813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1dcba30fbc34d668cd3d26220a2d5a6',ramdisk_id='',reservation_id='r-n2gi2s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-517268710',owner_user_name='tempest-ServerStableDeviceRescueTest-517268710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:31:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfd76997bb4634b509c13a32c29d46',uuid=88a50ff0-0263-4e3c-b624-220311195c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converting VIF {"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'pci_devices' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:31:11 user nova-compute[75097]:   <uuid>88a50ff0-0263-4e3c-b624-220311195c67</uuid>
Nov 14 16:31:11 user nova-compute[75097]:   <name>instance-0000002c</name>
Nov 14 16:31:11 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:31:11 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:31:11 user nova-compute[75097]:   <metadata>
Nov 14 16:31:11 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:31:11 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:31:11 user nova-compute[75097]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1235024558</nova:name>
Nov 14 16:31:11 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:31:11</nova:creationTime>
Nov 14 16:31:11 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:31:11 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:31:11 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:31:11 user nova-compute[75097]:       <nova:owner>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:user uuid="c2cfd76997bb4634b509c13a32c29d46">tempest-ServerStableDeviceRescueTest-517268710-project-member</nova:user>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:project uuid="e1dcba30fbc34d668cd3d26220a2d5a6">tempest-ServerStableDeviceRescueTest-517268710</nova:project>
Nov 14 16:31:11 user nova-compute[75097]:       </nova:owner>
Nov 14 16:31:11 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:31:11 user nova-compute[75097]:       <nova:ports>
Nov 14 16:31:11 user nova-compute[75097]:         <nova:port uuid="c52af853-423e-4a3d-aba9-bba3f47d7a0a">
Nov 14 16:31:11 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:31:11 user nova-compute[75097]:         </nova:port>
Nov 14 16:31:11 user nova-compute[75097]:       </nova:ports>
Nov 14 16:31:11 user nova-compute[75097]:     </nova:instance>
Nov 14 16:31:11 user nova-compute[75097]:   </metadata>
Nov 14 16:31:11 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:31:11 user nova-compute[75097]:     <system>
Nov 14 16:31:11 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:31:11 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:31:11 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:31:11 user nova-compute[75097]:       <entry name="serial">88a50ff0-0263-4e3c-b624-220311195c67</entry>
Nov 14 16:31:11 user nova-compute[75097]:       <entry name="uuid">88a50ff0-0263-4e3c-b624-220311195c67</entry>
Nov 14 16:31:11 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:31:11 user nova-compute[75097]:     </system>
Nov 14 16:31:11 user nova-compute[75097]:   </sysinfo>
Nov 14 16:31:11 user nova-compute[75097]:   <os>
Nov 14 16:31:11 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:31:11 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:31:11 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:31:11 user nova-compute[75097]:   </os>
Nov 14 16:31:11 user nova-compute[75097]:   <features>
Nov 14 16:31:11 user nova-compute[75097]:     <acpi/>
Nov 14 16:31:11 user nova-compute[75097]:     <apic/>
Nov 14 16:31:11 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:31:11 user nova-compute[75097]:   </features>
Nov 14 16:31:11 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:31:11 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:31:11 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:31:11 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:31:11 user nova-compute[75097]:   </clock>
Nov 14 16:31:11 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:31:11 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:31:11 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:31:11 user nova-compute[75097]:   </cpu>
Nov 14 16:31:11 user nova-compute[75097]:   <devices>
Nov 14 16:31:11 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:31:11 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:31:11 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk"/>
Nov 14 16:31:11 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:31:11 user nova-compute[75097]:     </disk>
Nov 14 16:31:11 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:31:11 user nova-compute[75097]:       <mac address="fa:16:3e:79:37:d8"/>
Nov 14 16:31:11 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:31:11 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:31:11 user nova-compute[75097]:       <target dev="tapc52af853-42"/>
Nov 14 16:31:11 user nova-compute[75097]:     </interface>
Nov 14 16:31:11 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:31:11 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/console.log" append="off"/>
Nov 14 16:31:11 user nova-compute[75097]:     </serial>
Nov 14 16:31:11 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:31:11 user nova-compute[75097]:     <video>
Nov 14 16:31:11 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:31:11 user nova-compute[75097]:     </video>
Nov 14 16:31:11 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:31:11 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:31:11 user nova-compute[75097]:     </rng>
Nov 14 16:31:11 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:31:11 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:31:11 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:31:11 user nova-compute[75097]:     </memballoon>
Nov 14 16:31:11 user nova-compute[75097]:   </devices>
Nov 14 16:31:11 user nova-compute[75097]: </domain>
Nov 14 16:31:11 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1235024558',display_name='tempest-ServerStableDeviceRescueTest-server-1235024558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1235024558',id=44,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzpTQLF/M4onCQrFMnOECKDng5gDhjER0ofgkjAyno5iri9RVa+DUBa3/HZrwQ9rYjPuAyHnI3rTEiDLYmoUajtjAF7IvvVJr1AV7x1/GOTEh2DSwxz1aM0P/qg9oKhhA==',key_name='tempest-keypair-43856813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1dcba30fbc34d668cd3d26220a2d5a6',ramdisk_id='',reservation_id='r-n2gi2s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-517268710',owner_user_name='tempest-ServerStableDeviceRescueTest-517268710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:31:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfd76997bb4634b509c13a32c29d46',uuid=88a50ff0-0263-4e3c-b624-220311195c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converting VIF {"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG os_vif [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f431203-3164-518d-87e5-b27f9e95fde0', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc52af853-42, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc52af853-42, col_values=(('qos', UUID('e4a68f2a-28d3-470c-87ed-0f3ccde6d42c')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc52af853-42, col_values=(('external_ids', {'iface-id': 'c52af853-423e-4a3d-aba9-bba3f47d7a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:37:d8', 'vm-uuid': '88a50ff0-0263-4e3c-b624-220311195c67'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:11 user nova-compute[75097]: INFO os_vif [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42')
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No VIF found with MAC fa:16:3e:79:37:d8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated VIF entry in instance network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:31:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-96c083ff-0051-4339-a604-7698616865ef req-f78f7707-94f6-4337-983b-900fd61dc13a service nova] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:31:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-909751cb-9ac1-4e4c-a01c-2105314a4608 req-fdacdea7-0779-4361-9f2d-d61d37e199c9 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-909751cb-9ac1-4e4c-a01c-2105314a4608 req-fdacdea7-0779-4361-9f2d-d61d37e199c9 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-909751cb-9ac1-4e4c-a01c-2105314a4608 req-fdacdea7-0779-4361-9f2d-d61d37e199c9 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-909751cb-9ac1-4e4c-a01c-2105314a4608 req-fdacdea7-0779-4361-9f2d-d61d37e199c9 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-909751cb-9ac1-4e4c-a01c-2105314a4608 req-fdacdea7-0779-4361-9f2d-d61d37e199c9 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:31:13 user nova-compute[75097]: WARNING nova.compute.manager [req-909751cb-9ac1-4e4c-a01c-2105314a4608 req-fdacdea7-0779-4361-9f2d-d61d37e199c9 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state building and task_state spawning.
Nov 14 16:31:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:31:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance spawned successfully.
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:31:15 user nova-compute[75097]: INFO nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:31:15 user nova-compute[75097]: INFO nova.compute.manager [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Took 5.55 seconds to build instance.
Nov 14 16:31:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0226224e-2ca2-44bd-affc-438f3b064b82 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.643s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-31f8e8f8-23f2-4e18-a4a0-e1e464fdea1b req-e47763b6-80c3-42ba-9505-1428094e7b56 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-31f8e8f8-23f2-4e18-a4a0-e1e464fdea1b req-e47763b6-80c3-42ba-9505-1428094e7b56 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-31f8e8f8-23f2-4e18-a4a0-e1e464fdea1b req-e47763b6-80c3-42ba-9505-1428094e7b56 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-31f8e8f8-23f2-4e18-a4a0-e1e464fdea1b req-e47763b6-80c3-42ba-9505-1428094e7b56 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-31f8e8f8-23f2-4e18-a4a0-e1e464fdea1b req-e47763b6-80c3-42ba-9505-1428094e7b56 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:31:15 user nova-compute[75097]: WARNING nova.compute.manager [req-31f8e8f8-23f2-4e18-a4a0-e1e464fdea1b req-e47763b6-80c3-42ba-9505-1428094e7b56 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state active and task_state None.
Nov 14 16:31:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:31:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:31:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:31:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:32 user nova-compute[75097]: INFO nova.compute.manager [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Terminating instance
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-79db3afd-4a88-4b08-89a5-76fd65dec69f req-505b67cf-f3d4-46b6-aa1f-a00802c7ae7e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-unplugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79db3afd-4a88-4b08-89a5-76fd65dec69f req-505b67cf-f3d4-46b6-aa1f-a00802c7ae7e service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79db3afd-4a88-4b08-89a5-76fd65dec69f req-505b67cf-f3d4-46b6-aa1f-a00802c7ae7e service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-79db3afd-4a88-4b08-89a5-76fd65dec69f req-505b67cf-f3d4-46b6-aa1f-a00802c7ae7e service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-79db3afd-4a88-4b08-89a5-76fd65dec69f req-505b67cf-f3d4-46b6-aa1f-a00802c7ae7e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-unplugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-79db3afd-4a88-4b08-89a5-76fd65dec69f req-505b67cf-f3d4-46b6-aa1f-a00802c7ae7e service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-unplugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:31:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Instance destroyed successfully.
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lazy-loading 'resources' on Instance uuid 8cf8cc4f-96f4-487a-8739-1fbedfd2d428 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1794728049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1794728049',id=40,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWjMB38v0CHSDkExGfizMV0zkx+nG7JjphfeFbyPPwZ3oQOHA2qZimou3chjEHK5krBIFzvwqphV02HiERggD6J2WzHMOHBYLcjbGGeRGMlGQybngEsKFUOLhfrWuoYBg==',key_name='tempest-keypair-1203540656',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b644535e1a5b431e830a9d0aa10294e3',ramdisk_id='',reservation_id='r-s23mde0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-347532404',owner_user_name='tempest-AttachVolumeShelveTestJSON-347532404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eff36d66033f4331aa582c9fd2eab626',uuid=8cf8cc4f-96f4-487a-8739-1fbedfd2d428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converting VIF {"id": "38115c8f-855f-478e-9ca6-5066d79321af", "address": "fa:16:3e:83:c3:b7", "network": {"id": "10acad91-8090-4e28-80e5-abad6ed6513f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-673523015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b644535e1a5b431e830a9d0aa10294e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38115c8f-85", "ovs_interfaceid": "38115c8f-855f-478e-9ca6-5066d79321af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG os_vif [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38115c8f-85, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30b05013-8250-40eb-9921-3d786acacd8b) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:33 user nova-compute[75097]: INFO os_vif [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c3:b7,bridge_name='br-int',has_traffic_filtering=True,id=38115c8f-855f-478e-9ca6-5066d79321af,network=Network(10acad91-8090-4e28-80e5-abad6ed6513f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38115c8f-85')
Nov 14 16:31:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Deleting instance files /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428_del
Nov 14 16:31:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Deletion of /opt/stack/data/nova/instances/8cf8cc4f-96f4-487a-8739-1fbedfd2d428_del complete
Nov 14 16:31:33 user nova-compute[75097]: INFO nova.compute.manager [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 16:31:33 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:31:33 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Took 0.65 seconds to deallocate network for instance.
Nov 14 16:31:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-fb29ddb7-fde5-43de-84e3-370a680125c0 req-b0d9d98d-3039-487c-8c4a-23e606f9044d service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-deleted-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:34 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Deleted allocations for instance 8cf8cc4f-96f4-487a-8739-1fbedfd2d428
Nov 14 16:31:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b05ea95-b111-41e6-be2c-9f3bd927cafe tempest-AttachVolumeShelveTestJSON-347532404 tempest-AttachVolumeShelveTestJSON-347532404-project-member] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-2711445b-9db2-452b-aefc-10107b2d141a req-95d83394-0766-4720-bf49-c749a6b6610a service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2711445b-9db2-452b-aefc-10107b2d141a req-95d83394-0766-4720-bf49-c749a6b6610a service nova] Acquiring lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2711445b-9db2-452b-aefc-10107b2d141a req-95d83394-0766-4720-bf49-c749a6b6610a service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2711445b-9db2-452b-aefc-10107b2d141a req-95d83394-0766-4720-bf49-c749a6b6610a service nova] Lock "8cf8cc4f-96f4-487a-8739-1fbedfd2d428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-2711445b-9db2-452b-aefc-10107b2d141a req-95d83394-0766-4720-bf49-c749a6b6610a service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] No waiting events found dispatching network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:31:34 user nova-compute[75097]: WARNING nova.compute.manager [req-2711445b-9db2-452b-aefc-10107b2d141a req-95d83394-0766-4720-bf49-c749a6b6610a service nova] [instance: 8cf8cc4f-96f4-487a-8739-1fbedfd2d428] Received unexpected event network-vif-plugged-38115c8f-855f-478e-9ca6-5066d79321af for instance with vm_state deleted and task_state None.
Nov 14 16:31:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-changed-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Refreshing instance network info cache due to event network-changed-9a21acae-db8c-4ca3-b94f-0702c36d01a3. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] Acquiring lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] Acquired lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG nova.network.neutron [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Refreshing network info cache for port 9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG nova.network.neutron [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updated VIF entry in instance network info cache for port 9a21acae-db8c-4ca3-b94f-0702c36d01a3. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG nova.network.neutron [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updating instance_info_cache with network_info: [{"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:31:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8aae6ca6-212c-44ce-97ab-f9ad8ba03d21 req-b6107a6c-1092-427a-80c9-61a1f24f3acb service nova] Releasing lock "refresh_cache-db271845-0b08-4019-b7c3-92c900997d15" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "db271845-0b08-4019-b7c3-92c900997d15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:51 user nova-compute[75097]: INFO nova.compute.manager [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Terminating instance
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.compute.manager [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-179e9503-9875-485a-b427-8acbb724493e req-98fb222a-342a-4dac-be25-bbb74ecdf582 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-vif-unplugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-179e9503-9875-485a-b427-8acbb724493e req-98fb222a-342a-4dac-be25-bbb74ecdf582 service nova] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-179e9503-9875-485a-b427-8acbb724493e req-98fb222a-342a-4dac-be25-bbb74ecdf582 service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-179e9503-9875-485a-b427-8acbb724493e req-98fb222a-342a-4dac-be25-bbb74ecdf582 service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-179e9503-9875-485a-b427-8acbb724493e req-98fb222a-342a-4dac-be25-bbb74ecdf582 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] No waiting events found dispatching network-vif-unplugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-179e9503-9875-485a-b427-8acbb724493e req-98fb222a-342a-4dac-be25-bbb74ecdf582 service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-vif-unplugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:31:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: db271845-0b08-4019-b7c3-92c900997d15] Instance destroyed successfully.
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'resources' on Instance uuid db271845-0b08-4019-b7c3-92c900997d15 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1835082309',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1835082309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1835082309',id=43,image_ref='2d8e2d2c-fe6d-46e2-a04d-9746ffd9fe02',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnfn1Sj8tumVUACi7yRiOd6Qg/M+Wd/Sb0hEI9VdpTOPg7osroKyan9uHgJi2Qtv9KJKC1hMfh345+l7mBcnqzkGExOwS2XNcSriHx49C93hb67LhK6qmVGREK2Y65qVg==',key_name='tempest-keypair-704691426',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:30:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-zbe94j6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1353533810',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=db271845-0b08-4019-b7c3-92c900997d15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "address": "fa:16:3e:54:3e:39", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a21acae-db", "ovs_interfaceid": "9a21acae-db8c-4ca3-b94f-0702c36d01a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_vif [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a21acae-db, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a816b223-ee2b-496f-8bfe-6c21fe6b7605) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:31:51 user nova-compute[75097]: INFO os_vif [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:3e:39,bridge_name='br-int',has_traffic_filtering=True,id=9a21acae-db8c-4ca3-b94f-0702c36d01a3,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a21acae-db')
Nov 14 16:31:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdKNYrxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:31:51 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1bc6c-b3b6-4c59-ad1c-4b374dc3d567]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:31:51 user nova-compute[75097]: No targets found.
Nov 14 16:31:51 user nova-compute[75097]: iSNS:
Nov 14 16:31:51 user nova-compute[75097]: No targets found.
Nov 14 16:31:51 user nova-compute[75097]: STATIC:
Nov 14 16:31:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2
Nov 14 16:31:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:31:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:31:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173
Nov 14 16:31:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:31:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:31:51 user nova-compute[75097]: FIRMWARE:
Nov 14 16:31:51 user nova-compute[75097]: No targets found.
Nov 14 16:31:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:31:51 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:31:51 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eb667c-3daf-4fbc-987e-e86dab158ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd1464-1f94-43d3-86fe-57d8a3599593]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:31:51 user nova-compute[75097]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 (non-flash)
Nov 14 16:31:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:31:51 user nova-compute[75097]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 (non-flash)
Nov 14 16:31:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafb8144040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8521cf-c5f6-4bea-93f4-580518d58633]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a1b5ba-e2eb-426e-af94-4a69d065140a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd47ce65-5848-43fe-ab68-f1e848d10757]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dcbbaf-d12a-4bce-af11-9315a70024db]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:31:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7a3eb7-44a9-4ecd-a27b-f8589788ee50]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4213cab-8b40-473d-b916-ced995af0c5b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260]
Nov 14 16:31:52 user nova-compute[75097]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173, portal: 172.16.0.220,3260] successful.
Nov 14 16:31:52 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:170d2282-719e-441c-95ff-097283b2a173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a95e2-7edc-4ac8-ae4d-b6a2e34372c2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== disconnect_volume: return (271ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:31:52 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Deleting instance files /opt/stack/data/nova/instances/db271845-0b08-4019-b7c3-92c900997d15_del
Nov 14 16:31:52 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Deletion of /opt/stack/data/nova/instances/db271845-0b08-4019-b7c3-92c900997d15_del complete
Nov 14 16:31:52 user nova-compute[75097]: INFO nova.compute.manager [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 16:31:52 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: db271845-0b08-4019-b7c3-92c900997d15] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: db271845-0b08-4019-b7c3-92c900997d15] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:31:52 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: db271845-0b08-4019-b7c3-92c900997d15] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:31:52 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: db271845-0b08-4019-b7c3-92c900997d15] Took 0.71 seconds to deallocate network for instance.
Nov 14 16:31:53 user nova-compute[75097]: INFO nova.compute.manager [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 16:31:53 user nova-compute[75097]: DEBUG nova.compute.manager [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: db271845-0b08-4019-b7c3-92c900997d15] Deleting volume: 170d2282-719e-441c-95ff-097283b2a173 {{(pid=75097) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] Acquiring lock "db271845-0b08-4019-b7c3-92c900997d15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] Lock "db271845-0b08-4019-b7c3-92c900997d15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] No waiting events found dispatching network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:31:53 user nova-compute[75097]: WARNING nova.compute.manager [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received unexpected event network-vif-plugged-9a21acae-db8c-4ca3-b94f-0702c36d01a3 for instance with vm_state active and task_state deleting.
Nov 14 16:31:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-6eb3450f-75e4-49b7-982e-6ac76a4defa6 req-055718e0-3513-4719-8972-6e9d90cf79ab service nova] [instance: db271845-0b08-4019-b7c3-92c900997d15] Received event network-vif-deleted-9a21acae-db8c-4ca3-b94f-0702c36d01a3 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:53 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Deleted allocations for instance db271845-0b08-4019-b7c3-92c900997d15
Nov 14 16:31:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-db58c912-be0c-416b-a135-ee9c4e1d7591 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "db271845-0b08-4019-b7c3-92c900997d15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.938s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:31:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:31:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:31:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:31:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:31:59 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:01 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:32:01 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.063743591308594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 20a52802-02e2-42df-aeae-63e5572d5564 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:32:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:32:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:32:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:08 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:32:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:32:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:32:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:32:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:32:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:32:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:32:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "20a52802-02e2-42df-aeae-63e5572d5564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:42 user nova-compute[75097]: INFO nova.compute.manager [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Terminating instance
Nov 14 16:32:42 user nova-compute[75097]: DEBUG nova.compute.manager [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-508c0629-5d61-4d89-a72f-c64280fef5aa req-3cface8d-8f8f-4696-8629-975a17f52f98 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-vif-unplugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-508c0629-5d61-4d89-a72f-c64280fef5aa req-3cface8d-8f8f-4696-8629-975a17f52f98 service nova] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-508c0629-5d61-4d89-a72f-c64280fef5aa req-3cface8d-8f8f-4696-8629-975a17f52f98 service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-508c0629-5d61-4d89-a72f-c64280fef5aa req-3cface8d-8f8f-4696-8629-975a17f52f98 service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-508c0629-5d61-4d89-a72f-c64280fef5aa req-3cface8d-8f8f-4696-8629-975a17f52f98 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] No waiting events found dispatching network-vif-unplugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:32:42 user nova-compute[75097]: DEBUG nova.compute.manager [req-508c0629-5d61-4d89-a72f-c64280fef5aa req-3cface8d-8f8f-4696-8629-975a17f52f98 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-vif-unplugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:32:43 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Instance destroyed successfully.
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.objects.instance [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'resources' on Instance uuid 20a52802-02e2-42df-aeae-63e5572d5564 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:28:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2074208297',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2074208297',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2074208297',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpDmmP5Jgh0hvzmw25gJLMWJOEMnYJPGtlcXu7RaArAJechsqV/3dtfUb2KXiws7cYgkreD0098jvqX3nxEf0QDRO2eZY7tIvhVPXNS0o6pASY9NPJ/3zzDuoRbtYAuOw==',key_name='tempest-keypair-891506828',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:28:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-u7v5vbq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=20a52802-02e2-42df-aeae-63e5572d5564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "address": "fa:16:3e:4f:70:7f", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e0afcb7-16", "ovs_interfaceid": "7e0afcb7-16b8-4e53-8889-fbecd6df1e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_vif [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e0afcb7-16, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ed16662-18a8-4e0b-ab0c-e7e937c9d6b4) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:43 user nova-compute[75097]: INFO os_vif [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:70:7f,bridge_name='br-int',has_traffic_filtering=True,id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e0afcb7-16')
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNYprPQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:32:43 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8500563-7760-405e-ad14-ceaacb3208b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:32:43 user nova-compute[75097]: No targets found.
Nov 14 16:32:43 user nova-compute[75097]: iSNS:
Nov 14 16:32:43 user nova-compute[75097]: No targets found.
Nov 14 16:32:43 user nova-compute[75097]: STATIC:
Nov 14 16:32:43 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2
Nov 14 16:32:43 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:32:43 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:32:43 user nova-compute[75097]: FIRMWARE:
Nov 14 16:32:43 user nova-compute[75097]: No targets found.
Nov 14 16:32:43 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:32:43 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:32:43 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e660b1-d805-4c29-8c34-78e4dfe078f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ea4747-ec54-4c4f-a026-2b50f32788c6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:32:43 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 (non-flash)
Nov 14 16:32:43 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafb8364a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d96f92-c286-433c-a8d1-c56b638bbe69]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd081c00-f5bc-4643-bf92-6e3d1d2d920d]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.072s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244a218-6fa4-49cd-b707-8b7b9b8c51b7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45ce98-e5c9-40f1-94b9-63a1edf99108]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_92fdb329', '/dev/disk/by-id/scsi-1SCST_BIO92fdb329-3fe795f42e1bcd7a', '/dev/disk/by-id/scsi-23366653739356634') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9814e7f2-47d5-44a9-8a3a-804ac884d506]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03f8a9-c4af-46d9-992f-4ca0f17131a0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6fad3-76bf-4ae3-b5c2-8586f4cd150c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260]
Nov 14 16:32:43 user nova-compute[75097]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2, portal: 172.16.0.220,3260] successful.
Nov 14 16:32:43 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46f84216-6c6f-45ae-8207-7c7d585306b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bcc6c-1a2d-4c2b-a6dd-74399921ec8f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== disconnect_volume: return (356ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:32:43 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Deleting instance files /opt/stack/data/nova/instances/20a52802-02e2-42df-aeae-63e5572d5564_del
Nov 14 16:32:43 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Deletion of /opt/stack/data/nova/instances/20a52802-02e2-42df-aeae-63e5572d5564_del complete
Nov 14 16:32:43 user nova-compute[75097]: INFO nova.compute.manager [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 16:32:43 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:32:43 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:32:44 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Took 0.82 seconds to deallocate network for instance.
Nov 14 16:32:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-7930faee-7b25-4796-9c56-7bf40eb42b09 req-afcfbf71-fb2a-4a02-90c5-23b85a815d2d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-vif-deleted-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:32:44 user nova-compute[75097]: INFO nova.compute.manager [req-7930faee-7b25-4796-9c56-7bf40eb42b09 req-afcfbf71-fb2a-4a02-90c5-23b85a815d2d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Neutron deleted interface 7e0afcb7-16b8-4e53-8889-fbecd6df1e4f; detaching it from the instance and deleting it from the info cache
Nov 14 16:32:44 user nova-compute[75097]: DEBUG nova.network.neutron [req-7930faee-7b25-4796-9c56-7bf40eb42b09 req-afcfbf71-fb2a-4a02-90c5-23b85a815d2d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-7930faee-7b25-4796-9c56-7bf40eb42b09 req-afcfbf71-fb2a-4a02-90c5-23b85a815d2d service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Detach interface failed, port_id=7e0afcb7-16b8-4e53-8889-fbecd6df1e4f, reason: Instance 20a52802-02e2-42df-aeae-63e5572d5564 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-0937afcf-fe1c-4689-8716-20d0eaf97708 req-eb4479ea-d6af-458c-9b95-e1905b729397 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received event network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0937afcf-fe1c-4689-8716-20d0eaf97708 req-eb4479ea-d6af-458c-9b95-e1905b729397 service nova] Acquiring lock "20a52802-02e2-42df-aeae-63e5572d5564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0937afcf-fe1c-4689-8716-20d0eaf97708 req-eb4479ea-d6af-458c-9b95-e1905b729397 service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0937afcf-fe1c-4689-8716-20d0eaf97708 req-eb4479ea-d6af-458c-9b95-e1905b729397 service nova] Lock "20a52802-02e2-42df-aeae-63e5572d5564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:44 user nova-compute[75097]: DEBUG nova.compute.manager [req-0937afcf-fe1c-4689-8716-20d0eaf97708 req-eb4479ea-d6af-458c-9b95-e1905b729397 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] No waiting events found dispatching network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:32:44 user nova-compute[75097]: WARNING nova.compute.manager [req-0937afcf-fe1c-4689-8716-20d0eaf97708 req-eb4479ea-d6af-458c-9b95-e1905b729397 service nova] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Received unexpected event network-vif-plugged-7e0afcb7-16b8-4e53-8889-fbecd6df1e4f for instance with vm_state active and task_state deleting.
Nov 14 16:32:45 user nova-compute[75097]: INFO nova.compute.manager [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 16:32:45 user nova-compute[75097]: DEBUG nova.compute.manager [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 20a52802-02e2-42df-aeae-63e5572d5564] Deleting volume: 46f84216-6c6f-45ae-8207-7c7d585306b2 {{(pid=75097) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 16:32:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:32:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:32:45 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:32:45 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:32:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:45 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Deleted allocations for instance 20a52802-02e2-42df-aeae-63e5572d5564
Nov 14 16:32:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-85cd6cd6-8ab0-4727-aa61-ba7be844a14f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "20a52802-02e2-42df-aeae-63e5572d5564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:32:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:32:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:32:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:33:00 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing instance network info cache due to event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated VIF entry in instance network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d85bc7e8-0a61-4fc4-9018-68845cb01c93 req-e76e47cb-4dc5-455a-8a55-f4fe66cb0577 service nova] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:33:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:33:02 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:33:02 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=25.045421600341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:02 user nova-compute[75097]: INFO nova.compute.manager [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] instance snapshotting
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:33:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Beginning live snapshot process
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json -f qcow2 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfkcqkssf/bc77ead6d1544b57b95e4fa72e59a8b6.delta 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfkcqkssf/bc77ead6d1544b57b95e4fa72e59a8b6.delta 1073741824" returned: 0 in 0.060s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 16:33:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:33:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75097) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 16:33:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 16:33:04 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:33:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfkcqkssf/bc77ead6d1544b57b95e4fa72e59a8b6.delta /opt/stack/data/nova/instances/snapshots/tmpfkcqkssf/bc77ead6d1544b57b95e4fa72e59a8b6 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:04 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:33:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfkcqkssf/bc77ead6d1544b57b95e4fa72e59a8b6.delta /opt/stack/data/nova/instances/snapshots/tmpfkcqkssf/bc77ead6d1544b57b95e4fa72e59a8b6" returned: 0 in 0.743s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:05 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Snapshot extracted, beginning image upload
Nov 14 16:33:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:07 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Snapshot image upload complete
Nov 14 16:33:07 user nova-compute[75097]: INFO nova.compute.manager [None req-48d54575-f98e-4707-836e-db3d283fa8b4 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Took 5.24 seconds to snapshot the instance on the hypervisor.
Nov 14 16:33:08 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:33:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:33:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:33:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:33:40 user nova-compute[75097]: INFO nova.compute.claims [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Claim successful on node user
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:33:40 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.policy [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc348d16cb0415fbbb357b7f030798e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea103d756c514917ae4aeb70b70b9097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:33:40 user nova-compute[75097]: INFO nova.virt.block_device [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Booting with volume cb12bee1-f663-4bb0-b4e3-9c5398f2b72c at /dev/vda
Nov 14 16:33:40 user nova-compute[75097]: DEBUG os_brick.utils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f751b6-0d3b-4743-a953-2108c9eeea5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201edf1-47fd-4aa7-9254-33f0476af67b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae14520-16f8-41f9-b125-1acf730b78c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[696121cd-3bda-44c0-b4bb-296dd63c88ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:33:40 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:33:40 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf087b3-ab56-439f-862c-ef35e0bfc2f9]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG os_brick.utils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updating existing volume attachment record: f856f201-5090-4122-86f6-4132cc00093b {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:33:40 user nova-compute[75097]: DEBUG nova.network.neutron [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Successfully created port: 289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Successfully updated port: 289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquired lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-changed-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.compute.manager [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Refreshing instance network info cache due to event network-changed-289d9814-defe-4a0f-8c64-b36edb0ad001. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] Acquiring lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.network.neutron [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updating instance_info_cache with network_info: [{"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Releasing lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Instance network_info: |[{"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] Acquired lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:33:41 user nova-compute[75097]: DEBUG nova.network.neutron [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Refreshing network info cache for port 289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:33:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updated VIF entry in instance network info cache for port 289d9814-defe-4a0f-8c64-b36edb0ad001. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:33:42 user nova-compute[75097]: DEBUG nova.network.neutron [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updating instance_info_cache with network_info: [{"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:33:42 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a1c9e691-600a-4e0c-a342-dc1db4437974 req-2ee70193-5bdc-4c27-9d24-8eece03f41e3 service nova] Releasing lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:33:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:33:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Creating image(s)
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Ensure instance console log exists: /opt/stack/data/nova/instances/68963bd3-ecb7-4f4e-a60e-7261971fc91e/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Start _get_guest_xml network_info=[{"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68963bd3-ecb7-4f4e-a60e-7261971fc91e', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'serial': 'cb12bee1-f663-4bb0-b4e3-9c5398f2b72c'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'f856f201-5090-4122-86f6-4132cc00093b', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:33:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:33:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:33:44 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:33:44 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:33:44 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586da3d-616f-424a-b188-519d2faba908]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:33:44 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aeeb64-e349-44c3-8df6-f91c8e22626b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c] added
Nov 14 16:33:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eaa466-7a2c-4517-a137-557ed8a5b427]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[60742155-1136-4cf2-8212-1995f5d2acc1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXHRitmA {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXHRitmA" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e5bd1-67b1-4a5d-a5b0-2fb59f51b638]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXHRitmA'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f42fcf-ebb0-40ec-ad7f-e5528f009f40]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949d2f9-1cec-4750-b07f-ff2b68fd855e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:33:45 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:33:45 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:33:45 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:33:45 user nova-compute[75097]: 
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[137c6292-ee8b-4dfd-86e8-65ec366f6930]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]
Nov 14 16:33:45 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.
Nov 14 16:33:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49cbbd-d4a3-4a9c-a66d-9e9dfb344154]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a90f02-0fa2-413e-912e-2d46f31baace]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:33:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:33:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.229s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635aa71-3ba0-4f56-b87a-c8a8110c5adf]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:33:45 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.255s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== connect_volume: return (1256ms) {'type': 'block', 'scsi_wwn': '26666636336313932', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666636336313932', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1795588589',display_name='tempest-TestVolumeBootPattern-server-1795588589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1795588589',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-ymozs59e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:33:40Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=68963bd3-ecb7-4f4e-a60e-7261971fc91e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.objects.instance [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'pci_devices' on Instance uuid 68963bd3-ecb7-4f4e-a60e-7261971fc91e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:33:46 user nova-compute[75097]:   <uuid>68963bd3-ecb7-4f4e-a60e-7261971fc91e</uuid>
Nov 14 16:33:46 user nova-compute[75097]:   <name>instance-0000002d</name>
Nov 14 16:33:46 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:33:46 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:33:46 user nova-compute[75097]:   <metadata>
Nov 14 16:33:46 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:33:46 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:33:46 user nova-compute[75097]:       <nova:name>tempest-TestVolumeBootPattern-server-1795588589</nova:name>
Nov 14 16:33:46 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:33:44</nova:creationTime>
Nov 14 16:33:46 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:33:46 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:33:46 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:33:46 user nova-compute[75097]:       <nova:owner>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:user uuid="7dc348d16cb0415fbbb357b7f030798e">tempest-TestVolumeBootPattern-1353533810-project-member</nova:user>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:project uuid="ea103d756c514917ae4aeb70b70b9097">tempest-TestVolumeBootPattern-1353533810</nova:project>
Nov 14 16:33:46 user nova-compute[75097]:       </nova:owner>
Nov 14 16:33:46 user nova-compute[75097]:       <nova:ports>
Nov 14 16:33:46 user nova-compute[75097]:         <nova:port uuid="289d9814-defe-4a0f-8c64-b36edb0ad001">
Nov 14 16:33:46 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:33:46 user nova-compute[75097]:         </nova:port>
Nov 14 16:33:46 user nova-compute[75097]:       </nova:ports>
Nov 14 16:33:46 user nova-compute[75097]:     </nova:instance>
Nov 14 16:33:46 user nova-compute[75097]:   </metadata>
Nov 14 16:33:46 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:33:46 user nova-compute[75097]:     <system>
Nov 14 16:33:46 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:33:46 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:33:46 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:33:46 user nova-compute[75097]:       <entry name="serial">68963bd3-ecb7-4f4e-a60e-7261971fc91e</entry>
Nov 14 16:33:46 user nova-compute[75097]:       <entry name="uuid">68963bd3-ecb7-4f4e-a60e-7261971fc91e</entry>
Nov 14 16:33:46 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:33:46 user nova-compute[75097]:     </system>
Nov 14 16:33:46 user nova-compute[75097]:   </sysinfo>
Nov 14 16:33:46 user nova-compute[75097]:   <os>
Nov 14 16:33:46 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:33:46 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:33:46 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:33:46 user nova-compute[75097]:   </os>
Nov 14 16:33:46 user nova-compute[75097]:   <features>
Nov 14 16:33:46 user nova-compute[75097]:     <acpi/>
Nov 14 16:33:46 user nova-compute[75097]:     <apic/>
Nov 14 16:33:46 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:33:46 user nova-compute[75097]:   </features>
Nov 14 16:33:46 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:33:46 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:33:46 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:33:46 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:33:46 user nova-compute[75097]:   </clock>
Nov 14 16:33:46 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:33:46 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:33:46 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:33:46 user nova-compute[75097]:   </cpu>
Nov 14 16:33:46 user nova-compute[75097]:   <devices>
Nov 14 16:33:46 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:33:46 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:33:46 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:33:46 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:33:46 user nova-compute[75097]:       <serial>cb12bee1-f663-4bb0-b4e3-9c5398f2b72c</serial>
Nov 14 16:33:46 user nova-compute[75097]:     </disk>
Nov 14 16:33:46 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:33:46 user nova-compute[75097]:       <mac address="fa:16:3e:a1:1b:3c"/>
Nov 14 16:33:46 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:33:46 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:33:46 user nova-compute[75097]:       <target dev="tap289d9814-de"/>
Nov 14 16:33:46 user nova-compute[75097]:     </interface>
Nov 14 16:33:46 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:33:46 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/68963bd3-ecb7-4f4e-a60e-7261971fc91e/console.log" append="off"/>
Nov 14 16:33:46 user nova-compute[75097]:     </serial>
Nov 14 16:33:46 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:33:46 user nova-compute[75097]:     <video>
Nov 14 16:33:46 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:33:46 user nova-compute[75097]:     </video>
Nov 14 16:33:46 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:33:46 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:33:46 user nova-compute[75097]:     </rng>
Nov 14 16:33:46 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:33:46 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:33:46 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:33:46 user nova-compute[75097]:     </memballoon>
Nov 14 16:33:46 user nova-compute[75097]:   </devices>
Nov 14 16:33:46 user nova-compute[75097]: </domain>
Nov 14 16:33:46 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1795588589',display_name='tempest-TestVolumeBootPattern-server-1795588589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1795588589',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-ymozs59e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:33:40Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=68963bd3-ecb7-4f4e-a60e-7261971fc91e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG os_vif [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a728d19-a837-59ff-943a-f0ef48abce0d', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap289d9814-de, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap289d9814-de, col_values=(('qos', UUID('7215b5c8-0fb5-4d97-a416-4ee711429fbe')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap289d9814-de, col_values=(('external_ids', {'iface-id': '289d9814-defe-4a0f-8c64-b36edb0ad001', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:1b:3c', 'vm-uuid': '68963bd3-ecb7-4f4e-a60e-7261971fc91e'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:46 user nova-compute[75097]: INFO os_vif [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de')
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:33:46 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No VIF found with MAC fa:16:3e:a1:1b:3c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-948b4787-c2f3-448e-b514-419d5455661b req-21217ab5-d2a4-4bd9-8bfc-970163e9408e service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-948b4787-c2f3-448e-b514-419d5455661b req-21217ab5-d2a4-4bd9-8bfc-970163e9408e service nova] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-948b4787-c2f3-448e-b514-419d5455661b req-21217ab5-d2a4-4bd9-8bfc-970163e9408e service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-948b4787-c2f3-448e-b514-419d5455661b req-21217ab5-d2a4-4bd9-8bfc-970163e9408e service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:47 user nova-compute[75097]: DEBUG nova.compute.manager [req-948b4787-c2f3-448e-b514-419d5455661b req-21217ab5-d2a4-4bd9-8bfc-970163e9408e service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] No waiting events found dispatching network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:33:47 user nova-compute[75097]: WARNING nova.compute.manager [req-948b4787-c2f3-448e-b514-419d5455661b req-21217ab5-d2a4-4bd9-8bfc-970163e9408e service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received unexpected event network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 for instance with vm_state building and task_state spawning.
Nov 14 16:33:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:33:49 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Instance spawned successfully.
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:33:49 user nova-compute[75097]: INFO nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Took 4.81 seconds to spawn the instance on the hypervisor.
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:33:49 user nova-compute[75097]: INFO nova.compute.manager [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Took 9.74 seconds to build instance.
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-35b144dc-faec-4854-9fb3-44a260e319bd req-f26b6553-9755-4e56-86f1-a92db39023f8 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-35b144dc-faec-4854-9fb3-44a260e319bd req-f26b6553-9755-4e56-86f1-a92db39023f8 service nova] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-35b144dc-faec-4854-9fb3-44a260e319bd req-f26b6553-9755-4e56-86f1-a92db39023f8 service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-35b144dc-faec-4854-9fb3-44a260e319bd req-f26b6553-9755-4e56-86f1-a92db39023f8 service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:49 user nova-compute[75097]: DEBUG nova.compute.manager [req-35b144dc-faec-4854-9fb3-44a260e319bd req-f26b6553-9755-4e56-86f1-a92db39023f8 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] No waiting events found dispatching network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:33:49 user nova-compute[75097]: WARNING nova.compute.manager [req-35b144dc-faec-4854-9fb3-44a260e319bd req-f26b6553-9755-4e56-86f1-a92db39023f8 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received unexpected event network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 for instance with vm_state active and task_state None.
Nov 14 16:33:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-52d317a2-e359-4566-8761-4b89e1788272 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.827s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:33:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:33:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:34:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:34:02 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:34:02 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=24.99431610107422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 68963bd3-ecb7-4f4e-a60e-7261971fc91e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:34:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:34:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:34:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:34:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:34:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:34:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'flavor' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:34:53 user nova-compute[75097]: INFO nova.compute.manager [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Attaching volume e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 to /dev/vdb
Nov 14 16:34:53 user nova-compute[75097]: DEBUG os_brick.utils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b380d4-89d0-4f0b-9721-c8ee73f29eeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151b32e-9a66-4eef-8e47-943ea54444ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac8e18e-6375-4a02-9f57-fcbd7699d01d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c6081-6fd6-41cc-9d61-012fd1d28e41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:34:53 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:34:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff830c0d-dc47-4170-9410-f28a7f8e5a04]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG os_brick.utils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:34:53 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating existing volume attachment record: a82fbda7-4915-4148-b427-b62e843491c2 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:34:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiEsuBvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:34:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:34:57 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:34:57 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e38fc-7ed0-4955-8e46-da1beba46592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:34:57 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7287386-34da-4166-9e85-5044f4200e4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77] added
Nov 14 16:34:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df6f56-a36a-48ba-9b91-c26e01e129ba]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da32e5c-4039-421e-a511-ca3eb04529ca]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiEsuBvG {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiEsuBvG" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f9e4b-d1e1-4d9d-bc14-e74031f4903e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZiEsuBvG'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81eb437-d337-462e-8305-a43e41b1ed72]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f4fb11-c903-4ed2-86e4-5bba877553d5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:34:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:34:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[944d241d-9f2b-4ed5-9fe0-4add91b3f8d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260]
Nov 14 16:34:57 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260] successful.
Nov 14 16:34:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d05c50-bbf6-402f-9300-2da413c5396f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b35618-2d2c-464b-9576-8c2d8a470c24]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:34:57 user nova-compute[75097]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:34:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:34:57 user nova-compute[75097]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:34:57 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:34:57 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:34:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:34:58 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e3642-4cfb-4d09-956c-1c924eeac25c]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:34:58 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:34:58 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiEsuBvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23537376636623566', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537376636623566', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'flavor' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:34:59 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:34:59 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:34:59 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:34:59 user nova-compute[75097]:   <serial>e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77</serial>
Nov 14 16:34:59 user nova-compute[75097]: </disk>
Nov 14 16:34:59 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No VIF found with MAC fa:16:3e:79:37:d8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:34:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-6ddf2890-20f4-4466-a9b0-a1fbb1370a8c tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.255s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:00 user nova-compute[75097]: INFO nova.compute.manager [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Rescuing
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updating instance_info_cache with network_info: [{"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-71a24dc9-73e0-4861-9d87-38751fb19049 req-7d4667f5-4cdc-43f9-b33b-24cc7dbde76e service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-71a24dc9-73e0-4861-9d87-38751fb19049 req-7d4667f5-4cdc-43f9-b33b-24cc7dbde76e service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-71a24dc9-73e0-4861-9d87-38751fb19049 req-7d4667f5-4cdc-43f9-b33b-24cc7dbde76e service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-71a24dc9-73e0-4861-9d87-38751fb19049 req-7d4667f5-4cdc-43f9-b33b-24cc7dbde76e service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-71a24dc9-73e0-4861-9d87-38751fb19049 req-7d4667f5-4cdc-43f9-b33b-24cc7dbde76e service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:35:00 user nova-compute[75097]: WARNING nova.compute.manager [req-71a24dc9-73e0-4861-9d87-38751fb19049 req-7d4667f5-4cdc-43f9-b33b-24cc7dbde76e service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state active and task_state rescuing.
Nov 14 16:35:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance destroyed successfully.
Nov 14 16:35:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Attempting a stable device rescue
Nov 14 16:35:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75097) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance directory exists: not creating {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 16:35:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Creating image(s)
Nov 14 16:35:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'trusted_certs' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "a82e5733a33085c4e1de6e448976d6ad50c03e4b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "a82e5733a33085c4e1de6e448976d6ad50c03e4b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.part --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG nova.virt.images [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] f1aea301-4be3-412c-862f-e1714472ea44 was qcow2, converting to raw {{(pid=75097) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG nova.privsep.utils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75097) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.part /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.converted {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-84efef85-801e-48fe-8caa-3dbf47ff09b7 req-5e1eee98-32b8-4e9b-8603-0896f031207c service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-84efef85-801e-48fe-8caa-3dbf47ff09b7 req-5e1eee98-32b8-4e9b-8603-0896f031207c service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-84efef85-801e-48fe-8caa-3dbf47ff09b7 req-5e1eee98-32b8-4e9b-8603-0896f031207c service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-84efef85-801e-48fe-8caa-3dbf47ff09b7 req-5e1eee98-32b8-4e9b-8603-0896f031207c service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:02 user nova-compute[75097]: DEBUG nova.compute.manager [req-84efef85-801e-48fe-8caa-3dbf47ff09b7 req-5e1eee98-32b8-4e9b-8603-0896f031207c service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:35:02 user nova-compute[75097]: WARNING nova.compute.manager [req-84efef85-801e-48fe-8caa-3dbf47ff09b7 req-5e1eee98-32b8-4e9b-8603-0896f031207c service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state active and task_state rescuing.
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.part /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.converted" returned: 0 in 0.456s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.converted --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "a82e5733a33085c4e1de6e448976d6ad50c03e4b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.849s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "a82e5733a33085c4e1de6e448976d6ad50c03e4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "a82e5733a33085c4e1de6e448976d6ad50c03e4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b,backing_fmt=raw /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b,backing_fmt=raw /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "a82e5733a33085c4e1de6e448976d6ad50c03e4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'migration_context' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Object Instance<88a50ff0-0263-4e3c-b624-220311195c67> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Start _get_guest_xml network_info=[{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "vif_mac": "fa:16:3e:79:37:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1aea301-4be3-412c-862f-e1714472ea44', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiEsuBvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '88a50ff0-0263-4e3c-b624-220311195c67', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'serial': 'e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'a82fbda7-4915-4148-b427-b62e843491c2', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'resources' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Object Instance<88a50ff0-0263-4e3c-b624-220311195c67> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'numa_topology' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Object Instance<88a50ff0-0263-4e3c-b624-220311195c67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:35:03 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:35:03 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'vcpu_model' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.objects.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Object Instance<88a50ff0-0263-4e3c-b624-220311195c67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiEsuBvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:35:03 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:35:03 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:35:03 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c093786-803c-46a4-921a-f886b52c987f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZiEsuBvG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 16:35:03 user nova-compute[75097]: node.name = iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77
Nov 14 16:35:03 user nova-compute[75097]: node.tpgt = -1
Nov 14 16:35:03 user nova-compute[75097]: node.startup = automatic
Nov 14 16:35:03 user nova-compute[75097]: node.leading_login = No
Nov 14 16:35:03 user nova-compute[75097]: iface.iscsi_ifacename = default
Nov 14 16:35:03 user nova-compute[75097]: iface.net_ifacename = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.ipaddress = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.prefix_len = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.hwaddress = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.transport_name = tcp
Nov 14 16:35:03 user nova-compute[75097]: iface.initiatorname = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.vlan_id = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.vlan_priority = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.vlan_state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.iface_num = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.mtu = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.port = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.bootproto = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.subnet_mask = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.gateway = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_alt_client_id = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_dns = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_learn_iqn = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_vendor_id_state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_vendor_id = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.dhcp_slp_da = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.fragmentation = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.gratuitous_arp = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.incoming_forwarding = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.tos_state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.tos = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.ttl = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.delayed_ack = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.tcp_nagle = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.tcp_wsf_state = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.tcp_wsf = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.tcp_timer_scale = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.tcp_timestamp = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.redirect = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.def_task_mgmt_timeout = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.header_digest = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.data_digest = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.immediate_data = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.initial_r2t = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.data_seq_inorder = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.data_pdu_inorder = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.erl = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.max_receive_data_len = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.first_burst_len = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.max_outstanding_r2t = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.max_burst_len = 0
Nov 14 16:35:03 user nova-compute[75097]: iface.chap_auth = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.bidi_chap = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.strict_login_compliance = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.discovery_auth = <empty>
Nov 14 16:35:03 user nova-compute[75097]: iface.discovery_logout = <empty>
Nov 14 16:35:03 user nova-compute[75097]: node.discovery_address = <empty>
Nov 14 16:35:03 user nova-compute[75097]: node.discovery_port = 0
Nov 14 16:35:03 user nova-compute[75097]: node.discovery_type = static
Nov 14 16:35:03 user nova-compute[75097]: node.session.initial_cmdsn = 0
Nov 14 16:35:03 user nova-compute[75097]: node.session.initial_login_retry_max = 8
Nov 14 16:35:03 user nova-compute[75097]: node.session.xmit_thread_priority = -20
Nov 14 16:35:03 user nova-compute[75097]: node.session.cmds_max = 128
Nov 14 16:35:03 user nova-compute[75097]: node.session.queue_depth = 32
Nov 14 16:35:03 user nova-compute[75097]: node.session.nr_sessions = 1
Nov 14 16:35:03 user nova-compute[75097]: node.session.auth.authmethod = CHAP
Nov 14 16:35:03 user nova-compute[75097]: node.session.auth.username = ZiEsuBvG
Nov 14 16:35:03 user nova-compute[75097]: node.session.auth.password = ***
Nov 14 16:35:03 user nova-compute[75097]: node.session.auth.username_in = <empty>
Nov 14 16:35:03 user nova-compute[75097]: node.session.auth.password_in = <empty>
Nov 14 16:35:03 user nova-compute[75097]: node.session.auth.chap_algs = MD5
Nov 14 16:35:03 user nova-compute[75097]: node.session.timeo.replacement_timeout = 120
Nov 14 16:35:03 user nova-compute[75097]: node.session.err_timeo.abort_timeout = 15
Nov 14 16:35:03 user nova-compute[75097]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 16:35:03 user nova-compute[75097]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 16:35:03 user nova-compute[75097]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.FastAbort = Yes
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.InitialR2T = No
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.ImmediateData = Yes
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.MaxConnections = 1
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 16:35:03 user nova-compute[75097]: node.session.iscsi.ERL = 0
Nov 14 16:35:03 user nova-compute[75097]: node.session.scan = manual
Nov 14 16:35:03 user nova-compute[75097]: node.session.reopen_max = 0
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].address = 172.16.0.220
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].port = 3260
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].startup = manual
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].tcp.window_size = 524288
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].tcp.type_of_service = 0
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].timeo.logout_timeout = 15
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].timeo.login_timeout = 15
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].timeo.auth_timeout = 45
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].iscsi.DataDigest = None
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].iscsi.IFMarker = No
Nov 14 16:35:03 user nova-compute[75097]: node.conn[0].iscsi.OFMarker = No
Nov 14 16:35:03 user nova-compute[75097]: # END RECORD
Nov 14 16:35:03 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2b0e67-ba02-4e56-8cc9-961433a921c8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3881e57-51bc-472c-900b-6fb9184caa4b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiEsuBvG {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:04 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:35:04 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=24.899234771728516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiEsuBvG" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[578174fe-8af5-4809-8390-07ec8be641a1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZiEsuBvG'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1e2b3-ee1e-4014-8d88-ead7bf3baee0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cffddc5-6d1e-4fd6-8f56-4dcb220f7107]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:35:04 user nova-compute[75097]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:35:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:35:04 user nova-compute[75097]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:35:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] HCTL ('34', '0', '0', 0) found on session 51 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62171f9-a3f8-4aab-ab00-ffd1cd10850e]: (4, ('0 0 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Searching for a device in session 51 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiEsuBvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.430s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] <== connect_volume: return (432ms) {'type': 'block', 'scsi_wwn': '23537376636623566', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537376636623566', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 68963bd3-ecb7-4f4e-a60e-7261971fc91e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1235024558',display_name='tempest-ServerStableDeviceRescueTest-server-1235024558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1235024558',id=44,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzpTQLF/M4onCQrFMnOECKDng5gDhjER0ofgkjAyno5iri9RVa+DUBa3/HZrwQ9rYjPuAyHnI3rTEiDLYmoUajtjAF7IvvVJr1AV7x1/GOTEh2DSwxz1aM0P/qg9oKhhA==',key_name='tempest-keypair-43856813',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:31:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1dcba30fbc34d668cd3d26220a2d5a6',ramdisk_id='',reservation_id='r-n2gi2s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-517268710',owner_user_name='tempest-ServerStableDeviceRescueTest-517268710-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfd76997bb4634b509c13a32c29d46',uuid=88a50ff0-0263-4e3c-b624-220311195c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "vif_mac": "fa:16:3e:79:37:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converting VIF {"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "vif_mac": "fa:16:3e:79:37:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'pci_devices' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.objects.base [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Object Instance<88a50ff0-0263-4e3c-b624-220311195c67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:35:04 user nova-compute[75097]:   <uuid>88a50ff0-0263-4e3c-b624-220311195c67</uuid>
Nov 14 16:35:04 user nova-compute[75097]:   <name>instance-0000002c</name>
Nov 14 16:35:04 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:35:04 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:35:04 user nova-compute[75097]:   <metadata>
Nov 14 16:35:04 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:35:04 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:35:04 user nova-compute[75097]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1235024558</nova:name>
Nov 14 16:35:04 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:35:03</nova:creationTime>
Nov 14 16:35:04 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:35:04 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:35:04 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:35:04 user nova-compute[75097]:       <nova:owner>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:user uuid="c2cfd76997bb4634b509c13a32c29d46">tempest-ServerStableDeviceRescueTest-517268710-project-member</nova:user>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:project uuid="e1dcba30fbc34d668cd3d26220a2d5a6">tempest-ServerStableDeviceRescueTest-517268710</nova:project>
Nov 14 16:35:04 user nova-compute[75097]:       </nova:owner>
Nov 14 16:35:04 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:35:04 user nova-compute[75097]:       <nova:ports>
Nov 14 16:35:04 user nova-compute[75097]:         <nova:port uuid="c52af853-423e-4a3d-aba9-bba3f47d7a0a">
Nov 14 16:35:04 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:35:04 user nova-compute[75097]:         </nova:port>
Nov 14 16:35:04 user nova-compute[75097]:       </nova:ports>
Nov 14 16:35:04 user nova-compute[75097]:     </nova:instance>
Nov 14 16:35:04 user nova-compute[75097]:   </metadata>
Nov 14 16:35:04 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:35:04 user nova-compute[75097]:     <system>
Nov 14 16:35:04 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:35:04 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:35:04 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:35:04 user nova-compute[75097]:       <entry name="serial">88a50ff0-0263-4e3c-b624-220311195c67</entry>
Nov 14 16:35:04 user nova-compute[75097]:       <entry name="uuid">88a50ff0-0263-4e3c-b624-220311195c67</entry>
Nov 14 16:35:04 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:35:04 user nova-compute[75097]:     </system>
Nov 14 16:35:04 user nova-compute[75097]:   </sysinfo>
Nov 14 16:35:04 user nova-compute[75097]:   <os>
Nov 14 16:35:04 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:35:04 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:35:04 user nova-compute[75097]:   </os>
Nov 14 16:35:04 user nova-compute[75097]:   <features>
Nov 14 16:35:04 user nova-compute[75097]:     <acpi/>
Nov 14 16:35:04 user nova-compute[75097]:     <apic/>
Nov 14 16:35:04 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:35:04 user nova-compute[75097]:   </features>
Nov 14 16:35:04 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:35:04 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:35:04 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:35:04 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:35:04 user nova-compute[75097]:   </clock>
Nov 14 16:35:04 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:35:04 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:35:04 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:35:04 user nova-compute[75097]:   </cpu>
Nov 14 16:35:04 user nova-compute[75097]:   <devices>
Nov 14 16:35:04 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:35:04 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:35:04 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk"/>
Nov 14 16:35:04 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:35:04 user nova-compute[75097]:     </disk>
Nov 14 16:35:04 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:35:04 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:35:04 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:35:04 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:35:04 user nova-compute[75097]:       <serial>e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77</serial>
Nov 14 16:35:04 user nova-compute[75097]:     </disk>
Nov 14 16:35:04 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:35:04 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:35:04 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue"/>
Nov 14 16:35:04 user nova-compute[75097]:       <target dev="vdc" bus="virtio"/>
Nov 14 16:35:04 user nova-compute[75097]:       <boot order="1"/>
Nov 14 16:35:04 user nova-compute[75097]:     </disk>
Nov 14 16:35:04 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:35:04 user nova-compute[75097]:       <mac address="fa:16:3e:79:37:d8"/>
Nov 14 16:35:04 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:35:04 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:35:04 user nova-compute[75097]:       <target dev="tapc52af853-42"/>
Nov 14 16:35:04 user nova-compute[75097]:     </interface>
Nov 14 16:35:04 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:35:04 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/console.log" append="off"/>
Nov 14 16:35:04 user nova-compute[75097]:     </serial>
Nov 14 16:35:04 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:35:04 user nova-compute[75097]:     <video>
Nov 14 16:35:04 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:35:04 user nova-compute[75097]:     </video>
Nov 14 16:35:04 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:35:04 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:35:04 user nova-compute[75097]:     </rng>
Nov 14 16:35:04 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:35:04 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:35:04 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:35:04 user nova-compute[75097]:     </memballoon>
Nov 14 16:35:04 user nova-compute[75097]:   </devices>
Nov 14 16:35:04 user nova-compute[75097]: </domain>
Nov 14 16:35:04 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:35:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance destroyed successfully.
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] No VIF found with MAC fa:16:3e:79:37:d8, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:35:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:35:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-1e098929-1831-48c7-95e6-4504f3626077 req-e7990173-a60d-4135-8db1-1e4447d8527c service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1e098929-1831-48c7-95e6-4504f3626077 req-e7990173-a60d-4135-8db1-1e4447d8527c service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1e098929-1831-48c7-95e6-4504f3626077 req-e7990173-a60d-4135-8db1-1e4447d8527c service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1e098929-1831-48c7-95e6-4504f3626077 req-e7990173-a60d-4135-8db1-1e4447d8527c service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-1e098929-1831-48c7-95e6-4504f3626077 req-e7990173-a60d-4135-8db1-1e4447d8527c service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:35:06 user nova-compute[75097]: WARNING nova.compute.manager [req-1e098929-1831-48c7-95e6-4504f3626077 req-e7990173-a60d-4135-8db1-1e4447d8527c service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state active and task_state rescuing.
Nov 14 16:35:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2b563138-53b5-4f21-ab42-a73dd3fe0d67 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:35:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-476413fc-fc03-45d7-b739-1af4825bfe89 req-93ad6bc4-9d57-45d3-8cd1-31f2ea5587df service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-476413fc-fc03-45d7-b739-1af4825bfe89 req-93ad6bc4-9d57-45d3-8cd1-31f2ea5587df service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-476413fc-fc03-45d7-b739-1af4825bfe89 req-93ad6bc4-9d57-45d3-8cd1-31f2ea5587df service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-476413fc-fc03-45d7-b739-1af4825bfe89 req-93ad6bc4-9d57-45d3-8cd1-31f2ea5587df service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-476413fc-fc03-45d7-b739-1af4825bfe89 req-93ad6bc4-9d57-45d3-8cd1-31f2ea5587df service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:35:08 user nova-compute[75097]: WARNING nova.compute.manager [req-476413fc-fc03-45d7-b739-1af4825bfe89 req-93ad6bc4-9d57-45d3-8cd1-31f2ea5587df service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state None.
Nov 14 16:35:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:35:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:35:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-changed-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Refreshing instance network info cache due to event network-changed-289d9814-defe-4a0f-8c64-b36edb0ad001. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:35:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] Acquiring lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:35:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] Acquired lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:35:31 user nova-compute[75097]: DEBUG nova.network.neutron [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Refreshing network info cache for port 289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updated VIF entry in instance network info cache for port 289d9814-defe-4a0f-8c64-b36edb0ad001. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG nova.network.neutron [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updating instance_info_cache with network_info: [{"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8d15750b-eaf4-40d4-b16d-d835eeb9685a req-1e6cdc56-d87e-4be6-b30c-77f016a743a2 service nova] Releasing lock "refresh_cache-68963bd3-ecb7-4f4e-a60e-7261971fc91e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:35:32 user nova-compute[75097]: INFO nova.compute.manager [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Terminating instance
Nov 14 16:35:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-858fb229-1059-4e43-84d6-b495b274dda2 req-fa979187-beed-4efc-8330-32f483cfcd26 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-vif-unplugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-858fb229-1059-4e43-84d6-b495b274dda2 req-fa979187-beed-4efc-8330-32f483cfcd26 service nova] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-858fb229-1059-4e43-84d6-b495b274dda2 req-fa979187-beed-4efc-8330-32f483cfcd26 service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-858fb229-1059-4e43-84d6-b495b274dda2 req-fa979187-beed-4efc-8330-32f483cfcd26 service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-858fb229-1059-4e43-84d6-b495b274dda2 req-fa979187-beed-4efc-8330-32f483cfcd26 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] No waiting events found dispatching network-vif-unplugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:35:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-858fb229-1059-4e43-84d6-b495b274dda2 req-fa979187-beed-4efc-8330-32f483cfcd26 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-vif-unplugged-289d9814-defe-4a0f-8c64-b36edb0ad001 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Instance destroyed successfully.
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'resources' on Instance uuid 68963bd3-ecb7-4f4e-a60e-7261971fc91e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:33:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1795588589',display_name='tempest-TestVolumeBootPattern-server-1795588589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1795588589',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:33:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-ymozs59e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:33:50Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=68963bd3-ecb7-4f4e-a60e-7261971fc91e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "289d9814-defe-4a0f-8c64-b36edb0ad001", "address": "fa:16:3e:a1:1b:3c", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289d9814-de", "ovs_interfaceid": "289d9814-defe-4a0f-8c64-b36edb0ad001", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_vif [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap289d9814-de, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7215b5c8-0fb5-4d97-a416-4ee711429fbe) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:35:33 user nova-compute[75097]: INFO os_vif [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:1b:3c,bridge_name='br-int',has_traffic_filtering=True,id=289d9814-defe-4a0f-8c64-b36edb0ad001,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289d9814-de')
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:35:33 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cb9b15-34b9-4ce7-be34-170efcad205a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:35:33 user nova-compute[75097]: No targets found.
Nov 14 16:35:33 user nova-compute[75097]: iSNS:
Nov 14 16:35:33 user nova-compute[75097]: No targets found.
Nov 14 16:35:33 user nova-compute[75097]: STATIC:
Nov 14 16:35:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c
Nov 14 16:35:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:35:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:35:33 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77
Nov 14 16:35:33 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:35:33 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:35:33 user nova-compute[75097]: FIRMWARE:
Nov 14 16:35:33 user nova-compute[75097]: No targets found.
Nov 14 16:35:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:35:33 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:35:33 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[392e708d-c874-40a9-bf6b-813c1481c604]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f08f9a-3b76-4063-b606-72a2a74848df]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:35:33 user nova-compute[75097]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:35:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:35:33 user nova-compute[75097]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:35:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf786ff760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec48b27-db15-47a4-8442-af99ae44ac8d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5f295-1c81-4313-a3f8-1a671c268f42]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985abea-dd06-4418-af8b-68eee771bda8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c9ec37-bf57-4d63-ab88-259c9c4b3f08]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8738935a-ffcc61924acbcb4f', '/dev/disk/by-id/scsi-26666636336313932', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8738935a') {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88103e86-ed9f-421a-9b53-fcc36a89485f]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42691192-f153-4ed0-9de0-7e9e09203676]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a4da9b-d396-4fa4-8a11-3ad53e0c9019]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]
Nov 14 16:35:33 user nova-compute[75097]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.
Nov 14 16:35:33 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e958c255-c80e-4785-be18-8b876b8ae709]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== disconnect_volume: return (282ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:35:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Deleting instance files /opt/stack/data/nova/instances/68963bd3-ecb7-4f4e-a60e-7261971fc91e_del
Nov 14 16:35:33 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Deletion of /opt/stack/data/nova/instances/68963bd3-ecb7-4f4e-a60e-7261971fc91e_del complete
Nov 14 16:35:33 user nova-compute[75097]: INFO nova.compute.manager [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 14 16:35:33 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:35:33 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:35:34 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:35:34 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Took 1.12 seconds to deallocate network for instance.
Nov 14 16:35:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] Acquiring lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] No waiting events found dispatching network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:35:34 user nova-compute[75097]: WARNING nova.compute.manager [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received unexpected event network-vif-plugged-289d9814-defe-4a0f-8c64-b36edb0ad001 for instance with vm_state active and task_state deleting.
Nov 14 16:35:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-d188527f-894a-4927-99c4-e9cb9502349f req-53c7f0da-e217-45dc-9745-cc0da98929a4 service nova] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Received event network-vif-deleted-289d9814-defe-4a0f-8c64-b36edb0ad001 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:35:35 user nova-compute[75097]: INFO nova.compute.manager [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 68963bd3-ecb7-4f4e-a60e-7261971fc91e] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 16:35:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:35:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:35:35 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:35:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:35:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:35 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Deleted allocations for instance 68963bd3-ecb7-4f4e-a60e-7261971fc91e
Nov 14 16:35:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-60469fe6-eb89-42a4-90a2-788f734c73b8 tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "68963bd3-ecb7-4f4e-a60e-7261971fc91e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.343s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:35:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:35:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:35:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:35:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:36:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:36:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:05 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:06 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:36:06 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=24.888599395751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:36:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:36:24 user nova-compute[75097]: INFO nova.compute.claims [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Claim successful on node user
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:36:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.policy [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc348d16cb0415fbbb357b7f030798e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea103d756c514917ae4aeb70b70b9097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:36:24 user nova-compute[75097]: INFO nova.virt.block_device [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Booting with volume cb12bee1-f663-4bb0-b4e3-9c5398f2b72c at /dev/vda
Nov 14 16:36:24 user nova-compute[75097]: DEBUG os_brick.utils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7004b-067f-4b06-8b83-f29d27be0c70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51345de8-9ad7-4f10-9ae8-70f8b745b575]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32f4a1f-cf31-49d6-a0ce-be422858222e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d95a1-9d7e-4581-9103-563fc1b1e3f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:36:24 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:36:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6771c22-b920-4d82-af65-c3a1990c8f68]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG os_brick.utils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:36:24 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating existing volume attachment record: 425eae08-2a2f-4a97-bd28-923cd0ae585f {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:36:25 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Successfully created port: e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:36:25 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Successfully updated port: e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:36:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:36:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-changed-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.compute.manager [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Refreshing instance network info cache due to event network-changed-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.network.neutron [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Instance network_info: |[{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.network.neutron [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Refreshing network info cache for port e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.network.neutron [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updated VIF entry in instance network info cache for port e16c2fbd-48e2-4ae8-a09a-c4118c9488a5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG nova.network.neutron [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:36:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1eca4646-f719-4922-8024-47b9728cfa02 req-72c5649e-573b-4824-8d9f-7fb7d6069b15 service nova] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:36:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Verify base images {{(pid=75097) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75097) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Image id 8453bef7-6457-4331-abaa-62588e201fe1 yields fingerprint a7b6cb177e19b2481fa7b98175dcb9d129c241ee {{(pid=75097) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] image 8453bef7-6457-4331-abaa-62588e201fe1 at (/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee): checking
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] image 8453bef7-6457-4331-abaa-62588e201fe1 at (/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee): image is in use {{(pid=75097) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] 88a50ff0-0263-4e3c-b624-220311195c67 is a valid instance name {{(pid=75097) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] 88a50ff0-0263-4e3c-b624-220311195c67 has a disk file {{(pid=75097) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Creating image(s)
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Ensure instance console log exists: /opt/stack/data/nova/instances/8d65e29b-5249-4d79-b98b-ca8c724f6c2e/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Start _get_guest_xml network_info=[{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d65e29b-5249-4d79-b98b-ca8c724f6c2e', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'serial': 'cb12bee1-f663-4bb0-b4e3-9c5398f2b72c'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '425eae08-2a2f-4a97-bd28-923cd0ae585f', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:36:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:36:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:36:29 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160f131-ac05-4a71-bbcc-e3a1b09d8b5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:36:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4984d0be-b7d0-4f84-b29a-3e762377f7f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c] added
Nov 14 16:36:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e87a9-ab1c-4e66-822f-2c08061c8cf9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 is backed by a7b6cb177e19b2481fa7b98175dcb9d129c241ee {{(pid=75097) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82
Nov 14 16:36:29 user nova-compute[75097]: WARNING nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Active base files: /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Removable base files: /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789 /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659 /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073 /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82 /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/053f11bb6eff8e38198b1f6521f2bb00b3e0c80d
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2de4265d5d3de0453a13e4042b3e19a972a111fb
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2b3f69f7e2dc509a8e5e8b9a0a332c2bb7364789
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/557796acdab1e8977b9d34fb609b2f15ab0e2659
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c994e2a306861d047867240bc23ce0e59172073
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a82e5733a33085c4e1de6e448976d6ad50c03e4b
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ed353afb77b70db9886d69ce4532a476e794030c
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f25b8391e0a3085238f082606b49c54640153f82
Nov 14 16:36:29 user nova-compute[75097]: INFO nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e7d9183320dfdf33dab303ccb7be71391dfd31d4
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Verification complete {{(pid=75097) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Verify swap images {{(pid=75097) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.imagecache [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Verify ephemeral images {{(pid=75097) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d3329-9ae5-488b-a292-94307b651de3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXHRitmA {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXHRitmA" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e01e3fc-d416-47b8-8030-98368e28cf0d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXHRitmA'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[36316ef7-e833-4a57-ad72-291ab7490b1f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81ccaa-e919-44ea-95e5-78492287086a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:36:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:36:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb20a62c-bef2-4535-9933-c748bfd9dc0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]
Nov 14 16:36:29 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.
Nov 14 16:36:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec9204-2be7-45b2-943c-09253ad50898]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486362c-a506-4026-91ea-5b0b2137a53f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:36:29 user nova-compute[75097]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:36:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:36:29 user nova-compute[75097]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:36:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[63815697-69b2-4b97-93ac-dc7e0268c5a2]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:36:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26666636336313932', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666636336313932', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1450663713',display_name='tempest-TestVolumeBootPattern-server-1450663713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1450663713',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-ebn4w15j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:36:25Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=8d65e29b-5249-4d79-b98b-ca8c724f6c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d65e29b-5249-4d79-b98b-ca8c724f6c2e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:36:30 user nova-compute[75097]:   <uuid>8d65e29b-5249-4d79-b98b-ca8c724f6c2e</uuid>
Nov 14 16:36:30 user nova-compute[75097]:   <name>instance-0000002e</name>
Nov 14 16:36:30 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:36:30 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:36:30 user nova-compute[75097]:   <metadata>
Nov 14 16:36:30 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:36:30 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:36:30 user nova-compute[75097]:       <nova:name>tempest-TestVolumeBootPattern-server-1450663713</nova:name>
Nov 14 16:36:30 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:36:29</nova:creationTime>
Nov 14 16:36:30 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:36:30 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:36:30 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:36:30 user nova-compute[75097]:       <nova:owner>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:user uuid="7dc348d16cb0415fbbb357b7f030798e">tempest-TestVolumeBootPattern-1353533810-project-member</nova:user>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:project uuid="ea103d756c514917ae4aeb70b70b9097">tempest-TestVolumeBootPattern-1353533810</nova:project>
Nov 14 16:36:30 user nova-compute[75097]:       </nova:owner>
Nov 14 16:36:30 user nova-compute[75097]:       <nova:ports>
Nov 14 16:36:30 user nova-compute[75097]:         <nova:port uuid="e16c2fbd-48e2-4ae8-a09a-c4118c9488a5">
Nov 14 16:36:30 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 16:36:30 user nova-compute[75097]:         </nova:port>
Nov 14 16:36:30 user nova-compute[75097]:       </nova:ports>
Nov 14 16:36:30 user nova-compute[75097]:     </nova:instance>
Nov 14 16:36:30 user nova-compute[75097]:   </metadata>
Nov 14 16:36:30 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:36:30 user nova-compute[75097]:     <system>
Nov 14 16:36:30 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:36:30 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:36:30 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:36:30 user nova-compute[75097]:       <entry name="serial">8d65e29b-5249-4d79-b98b-ca8c724f6c2e</entry>
Nov 14 16:36:30 user nova-compute[75097]:       <entry name="uuid">8d65e29b-5249-4d79-b98b-ca8c724f6c2e</entry>
Nov 14 16:36:30 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:36:30 user nova-compute[75097]:     </system>
Nov 14 16:36:30 user nova-compute[75097]:   </sysinfo>
Nov 14 16:36:30 user nova-compute[75097]:   <os>
Nov 14 16:36:30 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:36:30 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:36:30 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:36:30 user nova-compute[75097]:   </os>
Nov 14 16:36:30 user nova-compute[75097]:   <features>
Nov 14 16:36:30 user nova-compute[75097]:     <acpi/>
Nov 14 16:36:30 user nova-compute[75097]:     <apic/>
Nov 14 16:36:30 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:36:30 user nova-compute[75097]:   </features>
Nov 14 16:36:30 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:36:30 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:36:30 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:36:30 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:36:30 user nova-compute[75097]:   </clock>
Nov 14 16:36:30 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:36:30 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:36:30 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:36:30 user nova-compute[75097]:   </cpu>
Nov 14 16:36:30 user nova-compute[75097]:   <devices>
Nov 14 16:36:30 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:36:30 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:36:30 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:36:30 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:36:30 user nova-compute[75097]:       <serial>cb12bee1-f663-4bb0-b4e3-9c5398f2b72c</serial>
Nov 14 16:36:30 user nova-compute[75097]:     </disk>
Nov 14 16:36:30 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:36:30 user nova-compute[75097]:       <mac address="fa:16:3e:c7:0e:f5"/>
Nov 14 16:36:30 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:36:30 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:36:30 user nova-compute[75097]:       <target dev="tape16c2fbd-48"/>
Nov 14 16:36:30 user nova-compute[75097]:     </interface>
Nov 14 16:36:30 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:36:30 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/8d65e29b-5249-4d79-b98b-ca8c724f6c2e/console.log" append="off"/>
Nov 14 16:36:30 user nova-compute[75097]:     </serial>
Nov 14 16:36:30 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:36:30 user nova-compute[75097]:     <video>
Nov 14 16:36:30 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:36:30 user nova-compute[75097]:     </video>
Nov 14 16:36:30 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:36:30 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:36:30 user nova-compute[75097]:     </rng>
Nov 14 16:36:30 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:36:30 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:36:30 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:36:30 user nova-compute[75097]:     </memballoon>
Nov 14 16:36:30 user nova-compute[75097]:   </devices>
Nov 14 16:36:30 user nova-compute[75097]: </domain>
Nov 14 16:36:30 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1450663713',display_name='tempest-TestVolumeBootPattern-server-1450663713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1450663713',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-ebn4w15j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:36:25Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=8d65e29b-5249-4d79-b98b-ca8c724f6c2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG os_vif [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e736827f-e467-5e81-8d87-be7604717b87', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape16c2fbd-48, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape16c2fbd-48, col_values=(('qos', UUID('a707bb6c-8b5c-4214-96dd-b34f25ed4545')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape16c2fbd-48, col_values=(('external_ids', {'iface-id': 'e16c2fbd-48e2-4ae8-a09a-c4118c9488a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:0e:f5', 'vm-uuid': '8d65e29b-5249-4d79-b98b-ca8c724f6c2e'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:30 user nova-compute[75097]: INFO os_vif [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48')
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:36:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No VIF found with MAC fa:16:3e:c7:0e:f5, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:36:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-e777fd64-214a-466f-84b3-b2da49291cd3 req-d7bb60a9-50d3-4a44-a01b-4a10e5814b51 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e777fd64-214a-466f-84b3-b2da49291cd3 req-d7bb60a9-50d3-4a44-a01b-4a10e5814b51 service nova] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e777fd64-214a-466f-84b3-b2da49291cd3 req-d7bb60a9-50d3-4a44-a01b-4a10e5814b51 service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-e777fd64-214a-466f-84b3-b2da49291cd3 req-d7bb60a9-50d3-4a44-a01b-4a10e5814b51 service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG nova.compute.manager [req-e777fd64-214a-466f-84b3-b2da49291cd3 req-d7bb60a9-50d3-4a44-a01b-4a10e5814b51 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] No waiting events found dispatching network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:32 user nova-compute[75097]: WARNING nova.compute.manager [req-e777fd64-214a-466f-84b3-b2da49291cd3 req-d7bb60a9-50d3-4a44-a01b-4a10e5814b51 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received unexpected event network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 for instance with vm_state building and task_state spawning.
Nov 14 16:36:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:36:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Instance spawned successfully.
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-b061113f-88e1-4c4f-891c-8dee7561cefd req-5f8f345f-ab8f-4e31-b2b4-573d28324718 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b061113f-88e1-4c4f-891c-8dee7561cefd req-5f8f345f-ab8f-4e31-b2b4-573d28324718 service nova] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b061113f-88e1-4c4f-891c-8dee7561cefd req-5f8f345f-ab8f-4e31-b2b4-573d28324718 service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b061113f-88e1-4c4f-891c-8dee7561cefd req-5f8f345f-ab8f-4e31-b2b4-573d28324718 service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.compute.manager [req-b061113f-88e1-4c4f-891c-8dee7561cefd req-5f8f345f-ab8f-4e31-b2b4-573d28324718 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] No waiting events found dispatching network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:34 user nova-compute[75097]: WARNING nova.compute.manager [req-b061113f-88e1-4c4f-891c-8dee7561cefd req-5f8f345f-ab8f-4e31-b2b4-573d28324718 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received unexpected event network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 for instance with vm_state building and task_state spawning.
Nov 14 16:36:34 user nova-compute[75097]: INFO nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 14 16:36:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:36:34 user nova-compute[75097]: INFO nova.compute.manager [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Took 9.98 seconds to build instance.
Nov 14 16:36:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-28c9a139-0613-49bd-9c65-d086f7dbb8cf tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.077s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:36:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:51 user nova-compute[75097]: INFO nova.compute.manager [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Unrescuing
Nov 14 16:36:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'flavor' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-3f644e62-c57f-4a2b-801f-be2e7da27cac req-3f7fa812-fed4-4e24-bf34-3a83bb206a38 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3f644e62-c57f-4a2b-801f-be2e7da27cac req-3f7fa812-fed4-4e24-bf34-3a83bb206a38 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3f644e62-c57f-4a2b-801f-be2e7da27cac req-3f7fa812-fed4-4e24-bf34-3a83bb206a38 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3f644e62-c57f-4a2b-801f-be2e7da27cac req-3f7fa812-fed4-4e24-bf34-3a83bb206a38 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:51 user nova-compute[75097]: DEBUG nova.compute.manager [req-3f644e62-c57f-4a2b-801f-be2e7da27cac req-3f7fa812-fed4-4e24-bf34-3a83bb206a38 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:51 user nova-compute[75097]: WARNING nova.compute.manager [req-3f644e62-c57f-4a2b-801f-be2e7da27cac req-3f7fa812-fed4-4e24-bf34-3a83bb206a38 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance destroyed successfully.
Nov 14 16:36:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing instance network info cache due to event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated VIF entry in instance network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG nova.network.neutron [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1371cce-2aee-4c03-ae49-d77dfac7c003 req-c1ab1a1d-a7c2-46d8-b52c-e3504d3f6975 service nova] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:53 user nova-compute[75097]: WARNING nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:53 user nova-compute[75097]: WARNING nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:53 user nova-compute[75097]: WARNING nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:53 user nova-compute[75097]: WARNING nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:53 user nova-compute[75097]: WARNING nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:53 user nova-compute[75097]: DEBUG nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:53 user nova-compute[75097]: WARNING nova.compute.manager [req-191deafe-8be4-4b4f-a496-1f2699016b53 req-f0b50f6f-a93f-48f2-af04-87e4ac1ca9e4 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state rescued and task_state unrescuing.
Nov 14 16:36:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing instance network info cache due to event network-changed-c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Refreshing network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated VIF entry in instance network info cache for port c52af853-423e-4a3d-aba9-bba3f47d7a0a. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:36:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-010f9289-89b8-49fc-97c6-5167d8320726 req-f9527d57-525a-408f-88e1-ad9cb6dbc7e7 service nova] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8f11f6a0-80cc-4bb1-bbf6-5ea58d0d4ab7 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-af6de92a-a75a-41e3-9240-83f34b1a9d4f req-f18f3115-ab2c-4792-b1d8-cd5af0c0839f service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-af6de92a-a75a-41e3-9240-83f34b1a9d4f req-f18f3115-ab2c-4792-b1d8-cd5af0c0839f service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-af6de92a-a75a-41e3-9240-83f34b1a9d4f req-f18f3115-ab2c-4792-b1d8-cd5af0c0839f service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-af6de92a-a75a-41e3-9240-83f34b1a9d4f req-f18f3115-ab2c-4792-b1d8-cd5af0c0839f service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:36:55 user nova-compute[75097]: DEBUG nova.compute.manager [req-af6de92a-a75a-41e3-9240-83f34b1a9d4f req-f18f3115-ab2c-4792-b1d8-cd5af0c0839f service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:36:55 user nova-compute[75097]: WARNING nova.compute.manager [req-af6de92a-a75a-41e3-9240-83f34b1a9d4f req-f18f3115-ab2c-4792-b1d8-cd5af0c0839f service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state active and task_state None.
Nov 14 16:36:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:00 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:37:00 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:37:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [{"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-88a50ff0-0263-4e3c-b624-220311195c67" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:37:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:37:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:37:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:37:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8750MB free_disk=24.887252807617188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8d65e29b-5249-4d79-b98b-ca8c724f6c2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:37:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:37:08 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:37:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:37:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:37:24 user nova-compute[75097]: INFO nova.compute.manager [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Detaching volume e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77
Nov 14 16:37:24 user nova-compute[75097]: INFO nova.virt.block_device [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Attempting to driver detach volume e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 from mountpoint /dev/vdb
Nov 14 16:37:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Attempting to detach device vdb from instance 88a50ff0-0263-4e3c-b624-220311195c67 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:37:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:37:24 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:37:24 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:37:24 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:37:24 user nova-compute[75097]:   <serial>e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77</serial>
Nov 14 16:37:24 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:37:24 user nova-compute[75097]: </disk>
Nov 14 16:37:24 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:37:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Successfully detached device vdb from instance 88a50ff0-0263-4e3c-b624-220311195c67 from the persistent domain config.
Nov 14 16:37:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88a50ff0-0263-4e3c-b624-220311195c67 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:37:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:37:24 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:37:24 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:37:24 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:37:24 user nova-compute[75097]:   <serial>e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77</serial>
Nov 14 16:37:24 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:37:24 user nova-compute[75097]: </disk>
Nov 14 16:37:24 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:37:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:37:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:37:44 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 88a50ff0-0263-4e3c-b624-220311195c67 is timed out.
Nov 14 16:37:44 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Successfully detached device vdb from instance 88a50ff0-0263-4e3c-b624-220311195c67 from the live domain config.
Nov 14 16:37:44 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiEsuBvG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:37:44 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d308b6-4d72-4949-abad-4b4677512f16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:37:44 user nova-compute[75097]: No targets found.
Nov 14 16:37:44 user nova-compute[75097]: iSNS:
Nov 14 16:37:44 user nova-compute[75097]: No targets found.
Nov 14 16:37:44 user nova-compute[75097]: STATIC:
Nov 14 16:37:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c
Nov 14 16:37:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:37:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:37:44 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77
Nov 14 16:37:44 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:37:44 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:37:44 user nova-compute[75097]: FIRMWARE:
Nov 14 16:37:44 user nova-compute[75097]: No targets found.
Nov 14 16:37:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:37:44 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:37:44 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb94024c-433e-4a9f-ba7e-77916681da31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd2704e-2284-4edd-8ab7-f703a86bcd0f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:37:44 user nova-compute[75097]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:37:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 (non-flash)
Nov 14 16:37:44 user nova-compute[75097]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:37:44 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981d75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a18ba4-49d3-4b7a-89c1-148f1570af00]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a45d8b5-eba1-4ebe-83bb-5405635c6ef0]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b0d6f-3169-4a0b-a0ab-f215675cc8c0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[577cd9fb-5862-4087-91b1-12485cb2b1eb]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca16ea-d735-44c4-9d6e-9787a9f82acf]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:37:44 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[28595382-ca91-4a1d-981c-29f7c800e6f8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260]
Nov 14 16:37:45 user nova-compute[75097]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77, portal: 172.16.0.220,3260] successful.
Nov 14 16:37:45 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d93e38-0018-43a5-ad8b-a2fa9f9d5c77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be1d0a4-f466-4ccd-875c-e6a616ba514e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] <== disconnect_volume: return (276ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'flavor' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:37:45 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3611975f-06f7-459c-9c08-dbad91295209 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:37:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:37:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:38:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:38:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 8d65e29b-5249-4d79-b98b-ca8c724f6c2e {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "88a50ff0-0263-4e3c-b624-220311195c67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "88a50ff0-0263-4e3c-b624-220311195c67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:08 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:38:08 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=24.88637924194336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 88a50ff0-0263-4e3c-b624-220311195c67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8d65e29b-5249-4d79-b98b-ca8c724f6c2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:38:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:38:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:14 user nova-compute[75097]: INFO nova.compute.manager [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Terminating instance
Nov 14 16:38:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-8a8d9bc5-4f9b-478b-9c59-4f3fac041e2f req-0167978b-c863-4826-9f2b-e1a337d9cae8 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8a8d9bc5-4f9b-478b-9c59-4f3fac041e2f req-0167978b-c863-4826-9f2b-e1a337d9cae8 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8a8d9bc5-4f9b-478b-9c59-4f3fac041e2f req-0167978b-c863-4826-9f2b-e1a337d9cae8 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8a8d9bc5-4f9b-478b-9c59-4f3fac041e2f req-0167978b-c863-4826-9f2b-e1a337d9cae8 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-8a8d9bc5-4f9b-478b-9c59-4f3fac041e2f req-0167978b-c863-4826-9f2b-e1a337d9cae8 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-8a8d9bc5-4f9b-478b-9c59-4f3fac041e2f req-0167978b-c863-4826-9f2b-e1a337d9cae8 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-unplugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Instance destroyed successfully.
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lazy-loading 'resources' on Instance uuid 88a50ff0-0263-4e3c-b624-220311195c67 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1235024558',display_name='tempest-ServerStableDeviceRescueTest-server-1235024558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1235024558',id=44,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzpTQLF/M4onCQrFMnOECKDng5gDhjER0ofgkjAyno5iri9RVa+DUBa3/HZrwQ9rYjPuAyHnI3rTEiDLYmoUajtjAF7IvvVJr1AV7x1/GOTEh2DSwxz1aM0P/qg9oKhhA==',key_name='tempest-keypair-43856813',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:35:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1dcba30fbc34d668cd3d26220a2d5a6',ramdisk_id='',reservation_id='r-n2gi2s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-517268710',owner_user_name='tempest-ServerStableDeviceRescueTest-517268710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2cfd76997bb4634b509c13a32c29d46',uuid=88a50ff0-0263-4e3c-b624-220311195c67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converting VIF {"id": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "address": "fa:16:3e:79:37:d8", "network": {"id": "1e8e864f-f94d-47d1-a7af-ddb3efaea41b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-98854626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1dcba30fbc34d668cd3d26220a2d5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc52af853-42", "ovs_interfaceid": "c52af853-423e-4a3d-aba9-bba3f47d7a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG os_vif [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc52af853-42, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4a68f2a-28d3-470c-87ed-0f3ccde6d42c) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:38:15 user nova-compute[75097]: INFO os_vif [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=c52af853-423e-4a3d-aba9-bba3f47d7a0a,network=Network(1e8e864f-f94d-47d1-a7af-ddb3efaea41b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc52af853-42')
Nov 14 16:38:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Deleting instance files /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67_del
Nov 14 16:38:15 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Deletion of /opt/stack/data/nova/instances/88a50ff0-0263-4e3c-b624-220311195c67_del complete
Nov 14 16:38:15 user nova-compute[75097]: INFO nova.compute.manager [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 16:38:15 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:38:15 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:38:16 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:38:16 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Took 0.76 seconds to deallocate network for instance.
Nov 14 16:38:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-7ee2cf8f-1993-4179-b8c2-521ba7d7a7d8 req-c1f68325-5a2e-4fd1-b8d6-081f6d5f1880 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-deleted-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:16 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:38:16 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:38:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:16 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Deleted allocations for instance 88a50ff0-0263-4e3c-b624-220311195c67
Nov 14 16:38:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-aee8b68c-5672-4bb4-8039-fc7ac84c2b36 tempest-ServerStableDeviceRescueTest-517268710 tempest-ServerStableDeviceRescueTest-517268710-project-member] Lock "88a50ff0-0263-4e3c-b624-220311195c67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] Acquiring lock "88a50ff0-0263-4e3c-b624-220311195c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] Lock "88a50ff0-0263-4e3c-b624-220311195c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] No waiting events found dispatching network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:38:17 user nova-compute[75097]: WARNING nova.compute.manager [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 88a50ff0-0263-4e3c-b624-220311195c67] Received unexpected event network-vif-plugged-c52af853-423e-4a3d-aba9-bba3f47d7a0a for instance with vm_state deleted and task_state None.
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-changed-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Refreshing instance network info cache due to event network-changed-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Refreshing network info cache for port e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updated VIF entry in instance network info cache for port e16c2fbd-48e2-4ae8-a09a-c4118c9488a5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:38:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2b3428e3-1a87-48fb-983e-d1ccb83d0857 req-75beb952-c7a3-4816-8cc4-5365149f6af6 service nova] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:38:20 user nova-compute[75097]: INFO nova.compute.claims [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Claim successful on node user
Nov 14 16:38:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:38:20 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG nova.policy [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dc348d16cb0415fbbb357b7f030798e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea103d756c514917ae4aeb70b70b9097', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:38:20 user nova-compute[75097]: INFO nova.virt.block_device [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Booting with volume 238442e6-281a-425d-a4ef-eaf52c7a882e at /dev/vda
Nov 14 16:38:20 user nova-compute[75097]: DEBUG os_brick.utils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa55e99-beb2-4334-8fc0-815a093e8aae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2585af97-9c31-4180-8c3c-e12024e54f67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043b850-f296-48b6-8a5e-c37124a1e736]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ae92c-7ebf-492b-8977-974cb2833d33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:38:21 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:38:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f27d0-e2c2-45bd-8c12-af5af7b13daa]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG os_brick.utils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating existing volume attachment record: 2fd20c4e-a816-4cea-bd1e-1bf27eab153a {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:38:21 user nova-compute[75097]: DEBUG nova.network.neutron [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Successfully created port: 5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Successfully updated port: 5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquired lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-changed-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Refreshing instance network info cache due to event network-changed-5dc7abd8-4b9f-4498-a879-7d90bfb66e62. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] Acquiring lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Releasing lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Instance network_info: |[{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] Acquired lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:38:22 user nova-compute[75097]: DEBUG nova.network.neutron [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Refreshing network info cache for port 5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:38:23 user nova-compute[75097]: DEBUG nova.network.neutron [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updated VIF entry in instance network info cache for port 5dc7abd8-4b9f-4498-a879-7d90bfb66e62. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:38:23 user nova-compute[75097]: DEBUG nova.network.neutron [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:38:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-11f14220-f622-4107-b444-551519096aea req-932bdc83-e41c-415d-9010-e65bb68f6be0 service nova] Releasing lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:38:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Creating image(s)
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Did not create local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Ensure instance console log exists: /opt/stack/data/nova/instances/6048f331-a79b-41a2-9f0c-7c7316f381f0/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Start _get_guest_xml network_info=[{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmUnqLkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6048f331-a79b-41a2-9f0c-7c7316f381f0', 'attached_at': '', 'detached_at': '', 'volume_id': '238442e6-281a-425d-a4ef-eaf52c7a882e', 'serial': '238442e6-281a-425d-a4ef-eaf52c7a882e'}, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '2fd20c4e-a816-4cea-bd1e-1bf27eab153a', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:38:25 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:38:25 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:38:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmUnqLkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:38:25 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:38:25 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:38:25 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[226660ce-8987-4e40-80e7-529606c75f7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:38:25 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b055112-6c67-4282-8a01-14adbc7a3043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e] added
Nov 14 16:38:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5481bd-6e03-4301-a3af-73669ab76ba9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1702a1-2e68-4e3c-9913-c2fc9fabebd0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmUnqLkc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QmUnqLkc" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b355f-6295-4c35-98cc-f94dc55bf7bd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QmUnqLkc'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332b0da-1d21-495d-a6c9-a89e91c05090]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb11dc-e762-4b66-83da-776f8f684b4d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:38:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:38:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0d5ce5-f074-48d2-8f05-0b97262470b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260]
Nov 14 16:38:25 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260] successful.
Nov 14 16:38:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabe2c9-7cca-4db4-9f1a-8ffea064b227]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7c4e4-a3bf-4763-bf89-13e2c1b5a930]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:38:25 user nova-compute[75097]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e (non-flash)
Nov 14 16:38:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:38:25 user nova-compute[75097]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e (non-flash)
Nov 14 16:38:25 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b762c7-8fad-429e-af33-baa21bda2e0b]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:38:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmUnqLkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:38:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:38:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26465623734663536', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:38:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465623734663536', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135867253',display_name='tempest-TestVolumeBootPattern-server-135867253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135867253',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-hev02bl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:38:21Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=6048f331-a79b-41a2-9f0c-7c7316f381f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'pci_devices' on Instance uuid 6048f331-a79b-41a2-9f0c-7c7316f381f0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:38:27 user nova-compute[75097]:   <uuid>6048f331-a79b-41a2-9f0c-7c7316f381f0</uuid>
Nov 14 16:38:27 user nova-compute[75097]:   <name>instance-0000002f</name>
Nov 14 16:38:27 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:38:27 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:38:27 user nova-compute[75097]:   <metadata>
Nov 14 16:38:27 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:38:27 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:38:27 user nova-compute[75097]:       <nova:name>tempest-TestVolumeBootPattern-server-135867253</nova:name>
Nov 14 16:38:27 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:38:25</nova:creationTime>
Nov 14 16:38:27 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:38:27 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:38:27 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:38:27 user nova-compute[75097]:       <nova:owner>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:user uuid="7dc348d16cb0415fbbb357b7f030798e">tempest-TestVolumeBootPattern-1353533810-project-member</nova:user>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:project uuid="ea103d756c514917ae4aeb70b70b9097">tempest-TestVolumeBootPattern-1353533810</nova:project>
Nov 14 16:38:27 user nova-compute[75097]:       </nova:owner>
Nov 14 16:38:27 user nova-compute[75097]:       <nova:ports>
Nov 14 16:38:27 user nova-compute[75097]:         <nova:port uuid="5dc7abd8-4b9f-4498-a879-7d90bfb66e62">
Nov 14 16:38:27 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 16:38:27 user nova-compute[75097]:         </nova:port>
Nov 14 16:38:27 user nova-compute[75097]:       </nova:ports>
Nov 14 16:38:27 user nova-compute[75097]:     </nova:instance>
Nov 14 16:38:27 user nova-compute[75097]:   </metadata>
Nov 14 16:38:27 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:38:27 user nova-compute[75097]:     <system>
Nov 14 16:38:27 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:38:27 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:38:27 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:38:27 user nova-compute[75097]:       <entry name="serial">6048f331-a79b-41a2-9f0c-7c7316f381f0</entry>
Nov 14 16:38:27 user nova-compute[75097]:       <entry name="uuid">6048f331-a79b-41a2-9f0c-7c7316f381f0</entry>
Nov 14 16:38:27 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:38:27 user nova-compute[75097]:     </system>
Nov 14 16:38:27 user nova-compute[75097]:   </sysinfo>
Nov 14 16:38:27 user nova-compute[75097]:   <os>
Nov 14 16:38:27 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:38:27 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:38:27 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:38:27 user nova-compute[75097]:   </os>
Nov 14 16:38:27 user nova-compute[75097]:   <features>
Nov 14 16:38:27 user nova-compute[75097]:     <acpi/>
Nov 14 16:38:27 user nova-compute[75097]:     <apic/>
Nov 14 16:38:27 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:38:27 user nova-compute[75097]:   </features>
Nov 14 16:38:27 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:38:27 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:38:27 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:38:27 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:38:27 user nova-compute[75097]:   </clock>
Nov 14 16:38:27 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:38:27 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:38:27 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:38:27 user nova-compute[75097]:   </cpu>
Nov 14 16:38:27 user nova-compute[75097]:   <devices>
Nov 14 16:38:27 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:38:27 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:38:27 user nova-compute[75097]:       <source dev="/dev/sdc"/>
Nov 14 16:38:27 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:38:27 user nova-compute[75097]:       <serial>238442e6-281a-425d-a4ef-eaf52c7a882e</serial>
Nov 14 16:38:27 user nova-compute[75097]:     </disk>
Nov 14 16:38:27 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:38:27 user nova-compute[75097]:       <mac address="fa:16:3e:4f:9b:70"/>
Nov 14 16:38:27 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:38:27 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:38:27 user nova-compute[75097]:       <target dev="tap5dc7abd8-4b"/>
Nov 14 16:38:27 user nova-compute[75097]:     </interface>
Nov 14 16:38:27 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:38:27 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/6048f331-a79b-41a2-9f0c-7c7316f381f0/console.log" append="off"/>
Nov 14 16:38:27 user nova-compute[75097]:     </serial>
Nov 14 16:38:27 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:38:27 user nova-compute[75097]:     <video>
Nov 14 16:38:27 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:38:27 user nova-compute[75097]:     </video>
Nov 14 16:38:27 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:38:27 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:38:27 user nova-compute[75097]:     </rng>
Nov 14 16:38:27 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:38:27 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:38:27 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:38:27 user nova-compute[75097]:     </memballoon>
Nov 14 16:38:27 user nova-compute[75097]:   </devices>
Nov 14 16:38:27 user nova-compute[75097]: </domain>
Nov 14 16:38:27 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135867253',display_name='tempest-TestVolumeBootPattern-server-135867253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135867253',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-hev02bl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:38:21Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=6048f331-a79b-41a2-9f0c-7c7316f381f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG os_vif [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7d30577-e641-5915-af64-2ae9da62544e', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dc7abd8-4b, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dc7abd8-4b, col_values=(('qos', UUID('4914a753-845c-424c-afa6-02976c0567e1')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dc7abd8-4b, col_values=(('external_ids', {'iface-id': '5dc7abd8-4b9f-4498-a879-7d90bfb66e62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:9b:70', 'vm-uuid': '6048f331-a79b-41a2-9f0c-7c7316f381f0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:27 user nova-compute[75097]: INFO os_vif [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b')
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] No VIF found with MAC fa:16:3e:4f:9b:70, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:38:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-d231e085-2e15-48cc-80de-b00a6be849d1 req-36d2c4b8-ff44-4221-b7ec-455609cbd095 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d231e085-2e15-48cc-80de-b00a6be849d1 req-36d2c4b8-ff44-4221-b7ec-455609cbd095 service nova] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d231e085-2e15-48cc-80de-b00a6be849d1 req-36d2c4b8-ff44-4221-b7ec-455609cbd095 service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d231e085-2e15-48cc-80de-b00a6be849d1 req-36d2c4b8-ff44-4221-b7ec-455609cbd095 service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:28 user nova-compute[75097]: DEBUG nova.compute.manager [req-d231e085-2e15-48cc-80de-b00a6be849d1 req-36d2c4b8-ff44-4221-b7ec-455609cbd095 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] No waiting events found dispatching network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:38:28 user nova-compute[75097]: WARNING nova.compute.manager [req-d231e085-2e15-48cc-80de-b00a6be849d1 req-36d2c4b8-ff44-4221-b7ec-455609cbd095 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received unexpected event network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 for instance with vm_state building and task_state spawning.
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:38:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Instance spawned successfully.
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:38:30 user nova-compute[75097]: INFO nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Took 4.79 seconds to spawn the instance on the hypervisor.
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:38:30 user nova-compute[75097]: INFO nova.compute.manager [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Took 10.02 seconds to build instance.
Nov 14 16:38:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-35d91eb1-d6b4-469a-9b6e-b61b0349862f tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.110s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-d8397212-5a4e-4271-b381-c6a6ad282b9e req-22f180a6-bcb1-4e61-ac15-ab217697813f service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8397212-5a4e-4271-b381-c6a6ad282b9e req-22f180a6-bcb1-4e61-ac15-ab217697813f service nova] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8397212-5a4e-4271-b381-c6a6ad282b9e req-22f180a6-bcb1-4e61-ac15-ab217697813f service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8397212-5a4e-4271-b381-c6a6ad282b9e req-22f180a6-bcb1-4e61-ac15-ab217697813f service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:38:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-d8397212-5a4e-4271-b381-c6a6ad282b9e req-22f180a6-bcb1-4e61-ac15-ab217697813f service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] No waiting events found dispatching network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:38:30 user nova-compute[75097]: WARNING nova.compute.manager [req-d8397212-5a4e-4271-b381-c6a6ad282b9e req-22f180a6-bcb1-4e61-ac15-ab217697813f service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received unexpected event network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 for instance with vm_state active and task_state None.
Nov 14 16:38:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:38:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:38:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 8d65e29b-5249-4d79-b98b-ca8c724f6c2e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:39:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:39:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:39:07 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.009716033935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8d65e29b-5249-4d79-b98b-ca8c724f6c2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 6048f331-a79b-41a2-9f0c-7c7316f381f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:39:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:39:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:39:19 user nova-compute[75097]: INFO nova.compute.claims [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Claim successful on node user
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:39:19 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.policy [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e789fb8ecb2a4113aa3ad4e60f802cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4686cf09fac24c94b6cbc8b7f43c474c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:39:19 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Creating image(s)
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk 1073741824" returned: 0 in 0.050s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Successfully created port: 2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Cannot resize image /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Ensure instance console log exists: /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Successfully updated port: 2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-changed-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Refreshing instance network info cache due to event network-changed-2c4d4bcd-2658-498a-b41a-0b28762c2210. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance network_info: |[{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Refreshing network info cache for port 2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start _get_guest_xml network_info=[{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:39:21 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:39:21 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'pci_devices' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:39:21 user nova-compute[75097]:   <uuid>a56a42be-8543-402d-928b-fca06198cec7</uuid>
Nov 14 16:39:21 user nova-compute[75097]:   <name>instance-00000030</name>
Nov 14 16:39:21 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:39:21 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:39:21 user nova-compute[75097]:   <metadata>
Nov 14 16:39:21 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:39:21 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:39:21 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeTestJSON-server-1449290610</nova:name>
Nov 14 16:39:21 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:39:21</nova:creationTime>
Nov 14 16:39:21 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:39:21 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:39:21 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:39:21 user nova-compute[75097]:       <nova:owner>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:user uuid="e789fb8ecb2a4113aa3ad4e60f802cea">tempest-AttachVolumeTestJSON-350193510-project-member</nova:user>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:project uuid="4686cf09fac24c94b6cbc8b7f43c474c">tempest-AttachVolumeTestJSON-350193510</nova:project>
Nov 14 16:39:21 user nova-compute[75097]:       </nova:owner>
Nov 14 16:39:21 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:39:21 user nova-compute[75097]:       <nova:ports>
Nov 14 16:39:21 user nova-compute[75097]:         <nova:port uuid="2c4d4bcd-2658-498a-b41a-0b28762c2210">
Nov 14 16:39:21 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:39:21 user nova-compute[75097]:         </nova:port>
Nov 14 16:39:21 user nova-compute[75097]:       </nova:ports>
Nov 14 16:39:21 user nova-compute[75097]:     </nova:instance>
Nov 14 16:39:21 user nova-compute[75097]:   </metadata>
Nov 14 16:39:21 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:39:21 user nova-compute[75097]:     <system>
Nov 14 16:39:21 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:39:21 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:39:21 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:39:21 user nova-compute[75097]:       <entry name="serial">a56a42be-8543-402d-928b-fca06198cec7</entry>
Nov 14 16:39:21 user nova-compute[75097]:       <entry name="uuid">a56a42be-8543-402d-928b-fca06198cec7</entry>
Nov 14 16:39:21 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:39:21 user nova-compute[75097]:     </system>
Nov 14 16:39:21 user nova-compute[75097]:   </sysinfo>
Nov 14 16:39:21 user nova-compute[75097]:   <os>
Nov 14 16:39:21 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:39:21 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:39:21 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:39:21 user nova-compute[75097]:   </os>
Nov 14 16:39:21 user nova-compute[75097]:   <features>
Nov 14 16:39:21 user nova-compute[75097]:     <acpi/>
Nov 14 16:39:21 user nova-compute[75097]:     <apic/>
Nov 14 16:39:21 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:39:21 user nova-compute[75097]:   </features>
Nov 14 16:39:21 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:39:21 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:39:21 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:39:21 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:39:21 user nova-compute[75097]:   </clock>
Nov 14 16:39:21 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:39:21 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:39:21 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:39:21 user nova-compute[75097]:   </cpu>
Nov 14 16:39:21 user nova-compute[75097]:   <devices>
Nov 14 16:39:21 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:39:21 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:39:21 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk"/>
Nov 14 16:39:21 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:39:21 user nova-compute[75097]:     </disk>
Nov 14 16:39:21 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:39:21 user nova-compute[75097]:       <mac address="fa:16:3e:ec:26:9c"/>
Nov 14 16:39:21 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:39:21 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:39:21 user nova-compute[75097]:       <target dev="tap2c4d4bcd-26"/>
Nov 14 16:39:21 user nova-compute[75097]:     </interface>
Nov 14 16:39:21 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:39:21 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/console.log" append="off"/>
Nov 14 16:39:21 user nova-compute[75097]:     </serial>
Nov 14 16:39:21 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:39:21 user nova-compute[75097]:     <video>
Nov 14 16:39:21 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:39:21 user nova-compute[75097]:     </video>
Nov 14 16:39:21 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:39:21 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:39:21 user nova-compute[75097]:     </rng>
Nov 14 16:39:21 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:39:21 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:39:21 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:39:21 user nova-compute[75097]:     </memballoon>
Nov 14 16:39:21 user nova-compute[75097]:   </devices>
Nov 14 16:39:21 user nova-compute[75097]: </domain>
Nov 14 16:39:21 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG os_vif [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b83223a-c531-5c90-a94a-8941a499f866', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c4d4bcd-26, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c4d4bcd-26, col_values=(('qos', UUID('a75b8abb-cfeb-45e0-b7d5-b57cf62ef94c')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c4d4bcd-26, col_values=(('external_ids', {'iface-id': '2c4d4bcd-2658-498a-b41a-0b28762c2210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:26:9c', 'vm-uuid': 'a56a42be-8543-402d-928b-fca06198cec7'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:21 user nova-compute[75097]: INFO os_vif [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26')
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No VIF found with MAC fa:16:3e:ec:26:9c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updated VIF entry in instance network info cache for port 2c4d4bcd-2658-498a-b41a-0b28762c2210. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG nova.network.neutron [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:39:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9cb53998-8113-4b54-8e30-f93ec5d86c5e req-408e901e-3365-4286-9074-beefb3dd5d3e service nova] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b3d4ce8-5146-48d6-9d76-1728bdb81b89 req-7b776cbb-46b2-486a-81d2-e4806552f10f service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b3d4ce8-5146-48d6-9d76-1728bdb81b89 req-7b776cbb-46b2-486a-81d2-e4806552f10f service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b3d4ce8-5146-48d6-9d76-1728bdb81b89 req-7b776cbb-46b2-486a-81d2-e4806552f10f service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-4b3d4ce8-5146-48d6-9d76-1728bdb81b89 req-7b776cbb-46b2-486a-81d2-e4806552f10f service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:22 user nova-compute[75097]: DEBUG nova.compute.manager [req-4b3d4ce8-5146-48d6-9d76-1728bdb81b89 req-7b776cbb-46b2-486a-81d2-e4806552f10f service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:39:22 user nova-compute[75097]: WARNING nova.compute.manager [req-4b3d4ce8-5146-48d6-9d76-1728bdb81b89 req-7b776cbb-46b2-486a-81d2-e4806552f10f service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state building and task_state spawning.
Nov 14 16:39:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:39:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:39:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance spawned successfully.
Nov 14 16:39:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-a444440b-0214-4e18-ad9b-f3f54094e7e0 req-40830ae8-0932-4dad-b005-6c078de6da61 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a444440b-0214-4e18-ad9b-f3f54094e7e0 req-40830ae8-0932-4dad-b005-6c078de6da61 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a444440b-0214-4e18-ad9b-f3f54094e7e0 req-40830ae8-0932-4dad-b005-6c078de6da61 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a444440b-0214-4e18-ad9b-f3f54094e7e0 req-40830ae8-0932-4dad-b005-6c078de6da61 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-a444440b-0214-4e18-ad9b-f3f54094e7e0 req-40830ae8-0932-4dad-b005-6c078de6da61 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:39:25 user nova-compute[75097]: WARNING nova.compute.manager [req-a444440b-0214-4e18-ad9b-f3f54094e7e0 req-40830ae8-0932-4dad-b005-6c078de6da61 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state building and task_state spawning.
Nov 14 16:39:25 user nova-compute[75097]: INFO nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 14 16:39:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:39:25 user nova-compute[75097]: INFO nova.compute.manager [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Took 5.89 seconds to build instance.
Nov 14 16:39:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8810543e-7d48-4bfe-b1de-df95f5ed28d8 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.980s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:39:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:39:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:39:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:40:06 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:07 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:08 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:40:08 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=24.979480743408203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8d65e29b-5249-4d79-b98b-ca8c724f6c2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 6048f331-a79b-41a2-9f0c-7c7316f381f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:40:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:10 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:11 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:40:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-changed-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG nova.compute.manager [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Refreshing instance network info cache due to event network-changed-5dc7abd8-4b9f-4498-a879-7d90bfb66e62. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] Acquiring lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] Acquired lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG nova.network.neutron [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Refreshing network info cache for port 5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG nova.network.neutron [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updated VIF entry in instance network info cache for port 5dc7abd8-4b9f-4498-a879-7d90bfb66e62. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG nova.network.neutron [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:40:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a6c96832-b771-4a7f-97fe-063e8723be2d req-30b4641e-8df9-494e-9892-9d502a758dbd service nova] Releasing lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-changed-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Refreshing instance network info cache due to event network-changed-5dc7abd8-4b9f-4498-a879-7d90bfb66e62. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] Acquiring lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] Acquired lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Refreshing network info cache for port 5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:13 user nova-compute[75097]: INFO nova.compute.manager [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Terminating instance
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updated VIF entry in instance network info cache for port 5dc7abd8-4b9f-4498-a879-7d90bfb66e62. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [{"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bfee1bae-f785-470c-ac11-505f7f594eae req-8c1cbaf7-4d8a-4583-9d4e-a7139c9d6afd service nova] Releasing lock "refresh_cache-6048f331-a79b-41a2-9f0c-7c7316f381f0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-1eb5f5a9-407b-4862-b919-851c80731768 req-33e3dfdc-2131-4946-9d4f-397e37b41fb2 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-vif-unplugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1eb5f5a9-407b-4862-b919-851c80731768 req-33e3dfdc-2131-4946-9d4f-397e37b41fb2 service nova] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1eb5f5a9-407b-4862-b919-851c80731768 req-33e3dfdc-2131-4946-9d4f-397e37b41fb2 service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1eb5f5a9-407b-4862-b919-851c80731768 req-33e3dfdc-2131-4946-9d4f-397e37b41fb2 service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-1eb5f5a9-407b-4862-b919-851c80731768 req-33e3dfdc-2131-4946-9d4f-397e37b41fb2 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] No waiting events found dispatching network-vif-unplugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-1eb5f5a9-407b-4862-b919-851c80731768 req-33e3dfdc-2131-4946-9d4f-397e37b41fb2 service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-vif-unplugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:40:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Instance destroyed successfully.
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'resources' on Instance uuid 6048f331-a79b-41a2-9f0c-7c7316f381f0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135867253',display_name='tempest-TestVolumeBootPattern-server-135867253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135867253',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-hev02bl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:38:30Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=6048f331-a79b-41a2-9f0c-7c7316f381f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "address": "fa:16:3e:4f:9b:70", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc7abd8-4b", "ovs_interfaceid": "5dc7abd8-4b9f-4498-a879-7d90bfb66e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_vif [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dc7abd8-4b, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4914a753-845c-424c-afa6-02976c0567e1) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:14 user nova-compute[75097]: INFO os_vif [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9b:70,bridge_name='br-int',has_traffic_filtering=True,id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc7abd8-4b')
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QmUnqLkc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:40:14 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65dc66-f954-462b-a762-e9faf81de6bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:40:14 user nova-compute[75097]: No targets found.
Nov 14 16:40:14 user nova-compute[75097]: iSNS:
Nov 14 16:40:14 user nova-compute[75097]: No targets found.
Nov 14 16:40:14 user nova-compute[75097]: STATIC:
Nov 14 16:40:14 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c
Nov 14 16:40:14 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:40:14 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:40:14 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e
Nov 14 16:40:14 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:40:14 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:40:14 user nova-compute[75097]: FIRMWARE:
Nov 14 16:40:14 user nova-compute[75097]: No targets found.
Nov 14 16:40:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:40:14 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:40:14 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[200b4385-22b5-458b-87d0-4e3117c19a0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9390b3-3b74-4d1a-9821-beb0f06b4014]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:40:14 user nova-compute[75097]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e (non-flash)
Nov 14 16:40:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:40:14 user nova-compute[75097]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e (non-flash)
Nov 14 16:40:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafb81457e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef01bc-87fb-4f39-ab58-f5ac52b49286]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e2d99b-8939-4e0e-91da-107b8e8f9a3a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc87f701-1168-4db2-8978-a53978d56e24]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a3f8b-cfa4-48c1-823c-38ab8afc15ad]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bc332d48',) {{(pid=86343) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747d6d6-9d41-4686-8eb6-4b81a8e92b44]: (4, None) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2d8e0b-0e42-4028-b762-c0da6f754ea9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb18c18-9c3a-43af-a1ac-7998070eb299]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260]
Nov 14 16:40:14 user nova-compute[75097]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e, portal: 172.16.0.220,3260] successful.
Nov 14 16:40:14 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238442e6-281a-425d-a4ef-eaf52c7a882e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73698ae-143f-4951-b89b-c97bafd42426]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== disconnect_volume: return (291ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:40:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Deleting instance files /opt/stack/data/nova/instances/6048f331-a79b-41a2-9f0c-7c7316f381f0_del
Nov 14 16:40:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Deletion of /opt/stack/data/nova/instances/6048f331-a79b-41a2-9f0c-7c7316f381f0_del complete
Nov 14 16:40:14 user nova-compute[75097]: INFO nova.compute.manager [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 14 16:40:14 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:40:14 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Took 0.37 seconds to deallocate network for instance.
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-30cfb187-0930-4433-b92e-312de80ef94f req-4711fe0b-b89c-400d-b995-57fc0149475d service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-vif-deleted-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:40:14 user nova-compute[75097]: INFO nova.compute.manager [req-30cfb187-0930-4433-b92e-312de80ef94f req-4711fe0b-b89c-400d-b995-57fc0149475d service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Neutron deleted interface 5dc7abd8-4b9f-4498-a879-7d90bfb66e62; detaching it from the instance and deleting it from the info cache
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.network.neutron [req-30cfb187-0930-4433-b92e-312de80ef94f req-4711fe0b-b89c-400d-b995-57fc0149475d service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:40:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-30cfb187-0930-4433-b92e-312de80ef94f req-4711fe0b-b89c-400d-b995-57fc0149475d service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Detach interface failed, port_id=5dc7abd8-4b9f-4498-a879-7d90bfb66e62, reason: Instance 6048f331-a79b-41a2-9f0c-7c7316f381f0 could not be found. {{(pid=75097) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:40:15 user nova-compute[75097]: INFO nova.compute.manager [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-0a258609-7fd9-4512-bf7c-90f3b90262c3 req-2d6aa9ad-38d1-4353-b341-de0f2f2e0d8a service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received event network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0a258609-7fd9-4512-bf7c-90f3b90262c3 req-2d6aa9ad-38d1-4353-b341-de0f2f2e0d8a service nova] Acquiring lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0a258609-7fd9-4512-bf7c-90f3b90262c3 req-2d6aa9ad-38d1-4353-b341-de0f2f2e0d8a service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0a258609-7fd9-4512-bf7c-90f3b90262c3 req-2d6aa9ad-38d1-4353-b341-de0f2f2e0d8a service nova] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:15 user nova-compute[75097]: DEBUG nova.compute.manager [req-0a258609-7fd9-4512-bf7c-90f3b90262c3 req-2d6aa9ad-38d1-4353-b341-de0f2f2e0d8a service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] No waiting events found dispatching network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:40:15 user nova-compute[75097]: WARNING nova.compute.manager [req-0a258609-7fd9-4512-bf7c-90f3b90262c3 req-2d6aa9ad-38d1-4353-b341-de0f2f2e0d8a service nova] [instance: 6048f331-a79b-41a2-9f0c-7c7316f381f0] Received unexpected event network-vif-plugged-5dc7abd8-4b9f-4498-a879-7d90bfb66e62 for instance with vm_state deleted and task_state None.
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:15 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Deleted allocations for instance 6048f331-a79b-41a2-9f0c-7c7316f381f0
Nov 14 16:40:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b52cf72-f5eb-4d7a-bdf2-5ec8007690be tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "6048f331-a79b-41a2-9f0c-7c7316f381f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:40:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:40:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:40:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:40:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:40:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:40:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:40:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 8d65e29b-5249-4d79-b98b-ca8c724f6c2e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:41:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-changed-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Refreshing instance network info cache due to event network-changed-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] Acquiring lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] Acquired lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG nova.network.neutron [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Refreshing network info cache for port e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:08 user nova-compute[75097]: INFO nova.compute.manager [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Terminating instance
Nov 14 16:41:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c9c208a-d741-4ab5-8759-78b2394c8538 req-f49345bf-2731-44f1-aec7-805562cc405e service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-vif-unplugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c9c208a-d741-4ab5-8759-78b2394c8538 req-f49345bf-2731-44f1-aec7-805562cc405e service nova] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c9c208a-d741-4ab5-8759-78b2394c8538 req-f49345bf-2731-44f1-aec7-805562cc405e service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c9c208a-d741-4ab5-8759-78b2394c8538 req-f49345bf-2731-44f1-aec7-805562cc405e service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c9c208a-d741-4ab5-8759-78b2394c8538 req-f49345bf-2731-44f1-aec7-805562cc405e service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] No waiting events found dispatching network-vif-unplugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c9c208a-d741-4ab5-8759-78b2394c8538 req-f49345bf-2731-44f1-aec7-805562cc405e service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-vif-unplugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:41:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Instance destroyed successfully.
Nov 14 16:41:09 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:41:09 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=24.970630645751953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lazy-loading 'resources' on Instance uuid 8d65e29b-5249-4d79-b98b-ca8c724f6c2e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1450663713',display_name='tempest-TestVolumeBootPattern-server-1450663713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1450663713',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdBervqcPh2W1b2PLHtJfHRQE0hevKBagrrQBUL9QnYT02FSSQYAd4mE2w8MU26+HeEdi1ieTQKsdmn/vGx8SXFy6/U14Z1C3uFNZ0deZdpSIzbBpQktV95xY9gzAxHMg==',key_name='tempest-TestVolumeBootPattern-351331621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:36:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea103d756c514917ae4aeb70b70b9097',ramdisk_id='',reservation_id='r-ebn4w15j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1353533810',owner_user_name='tempest-TestVolumeBootPattern-1353533810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:36:34Z,user_data=None,user_id='7dc348d16cb0415fbbb357b7f030798e',uuid=8d65e29b-5249-4d79-b98b-ca8c724f6c2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converting VIF {"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_vif [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape16c2fbd-48, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a707bb6c-8b5c-4214-96dd-b34f25ed4545) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:09 user nova-compute[75097]: INFO os_vif [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:0e:f5,bridge_name='br-int',has_traffic_filtering=True,id=e16c2fbd-48e2-4ae8-a09a-c4118c9488a5,network=Network(3c0bd57c-2885-4355-99da-3fc24ea45e36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16c2fbd-48')
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXHRitmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:41:09 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e908d0-dd0c-4f5c-aac1-4b8a4008dd51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:41:09 user nova-compute[75097]: No targets found.
Nov 14 16:41:09 user nova-compute[75097]: iSNS:
Nov 14 16:41:09 user nova-compute[75097]: No targets found.
Nov 14 16:41:09 user nova-compute[75097]: STATIC:
Nov 14 16:41:09 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c
Nov 14 16:41:09 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:41:09 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:41:09 user nova-compute[75097]: FIRMWARE:
Nov 14 16:41:09 user nova-compute[75097]: No targets found.
Nov 14 16:41:09 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:41:09 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:41:09 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[674d8850-a444-4629-a35e-99f23a0ed49b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 8d65e29b-5249-4d79-b98b-ca8c724f6c2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f885e4e-7987-4443-ab79-13df4cdebf75]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:41:09 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c (non-flash)
Nov 14 16:41:09 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf78554280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5532ab5-60c8-4f39-b9b8-fb6a747e6f2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d06fb-971f-4d6d-a9ca-d48524ab8068]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d719df-17ee-4689-8977-318653c99a90]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6443c4-a16b-45db-9270-e62ecc495f79]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[62920eb2-481a-4c99-b5f3-eb5ccfdd9f9b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updated VIF entry in instance network info cache for port e16c2fbd-48e2-4ae8-a09a-c4118c9488a5. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.network.neutron [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [{"id": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "address": "fa:16:3e:c7:0e:f5", "network": {"id": "3c0bd57c-2885-4355-99da-3fc24ea45e36", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2137618708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea103d756c514917ae4aeb70b70b9097", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape16c2fbd-48", "ovs_interfaceid": "e16c2fbd-48e2-4ae8-a09a-c4118c9488a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-66d2e402-2633-4253-935d-dd34a3ffb643 req-607e9041-e1ef-4511-baf0-fae3ce4d9a42 service nova] Releasing lock "refresh_cache-8d65e29b-5249-4d79-b98b-ca8c724f6c2e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e47c5-5539-4e68-933c-148cd965db7c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260]
Nov 14 16:41:09 user nova-compute[75097]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c, portal: 172.16.0.220,3260] successful.
Nov 14 16:41:09 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb12bee1-f663-4bb0-b4e3-9c5398f2b72c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c4bc9-86eb-4b22-a577-6b84adb70f94]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] <== disconnect_volume: return (295ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:41:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Deleting instance files /opt/stack/data/nova/instances/8d65e29b-5249-4d79-b98b-ca8c724f6c2e_del
Nov 14 16:41:09 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Deletion of /opt/stack/data/nova/instances/8d65e29b-5249-4d79-b98b-ca8c724f6c2e_del complete
Nov 14 16:41:09 user nova-compute[75097]: INFO nova.compute.manager [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 14 16:41:09 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:41:09 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:41:10 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:41:10 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Took 0.51 seconds to deallocate network for instance.
Nov 14 16:41:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-changed-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:10 user nova-compute[75097]: DEBUG nova.compute.manager [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Refreshing instance network info cache due to event network-changed-2c4d4bcd-2658-498a-b41a-0b28762c2210. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:41:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:41:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:41:10 user nova-compute[75097]: DEBUG nova.network.neutron [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Refreshing network info cache for port 2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updated VIF entry in instance network info cache for port 2c4d4bcd-2658-498a-b41a-0b28762c2210. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.network.neutron [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-53da02a5-26a9-4796-902b-dbc56770c865 req-456d0670-a37f-4f00-90aa-69d8311d38ab service nova] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] Acquiring lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] No waiting events found dispatching network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:41:11 user nova-compute[75097]: WARNING nova.compute.manager [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received unexpected event network-vif-plugged-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 for instance with vm_state active and task_state deleting.
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.compute.manager [req-32a95053-28c9-4ca8-a56b-112e0bf04c21 req-61e63a61-3cbc-4ca2-9133-71d8a56eca3c service nova] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Received event network-vif-deleted-e16c2fbd-48e2-4ae8-a09a-c4118c9488a5 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:11 user nova-compute[75097]: INFO nova.compute.manager [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] [instance: 8d65e29b-5249-4d79-b98b-ca8c724f6c2e] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:11 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Deleted allocations for instance 8d65e29b-5249-4d79-b98b-ca8c724f6c2e
Nov 14 16:41:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8ee2d45c-4714-46b9-bafc-0269aa83351c tempest-TestVolumeBootPattern-1353533810 tempest-TestVolumeBootPattern-1353533810-project-member] Lock "8d65e29b-5249-4d79-b98b-ca8c724f6c2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.031s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:12 user nova-compute[75097]: INFO nova.compute.manager [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Attaching volume 4cb6d50b-60b4-435c-9aca-7f46cbfe5870 to /dev/vdb
Nov 14 16:41:12 user nova-compute[75097]: DEBUG os_brick.utils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a919fdb-23cd-403d-b047-36774329adc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8036b-e7d0-451c-830f-dae81049d5ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[64196daf-297b-4abb-b844-05c8ffe573df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[da10e4ad-90ab-4992-8ef9-8c3f64a9350f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:41:12 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[948eae20-3c6a-4f18-8c9f-d6ce08bed1ad]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG os_brick.utils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating existing volume attachment record: 1dfc700b-a24a-44b6-bef0-041ea1af4529 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:41:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:41:16 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:41:16 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:41:16 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[43828457-aa68-4ddf-9cf2-849dc6b861ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:41:16 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce218862-8384-40fa-a888-ffb70789115a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870] added
Nov 14 16:41:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741d606-b6c7-48ee-9d42-ef5069131b56]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa0688a-d643-4c27-8823-0c2761dd663a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eoRpIgtP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eoRpIgtP" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aff49f-5f2e-4fdc-b298-45b76587cc95]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eoRpIgtP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bf1999-b5fb-433b-9315-e5f462c6990e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e495aa-645c-4b51-b8ac-bf4b2b8d2e45]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:41:16 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:41:16 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:41:16 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:41:16 user nova-compute[75097]: 
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b52623-fde0-4f83-9198-ca7ec1f4a1dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]
Nov 14 16:41:16 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.
Nov 14 16:41:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5816046d-b7c9-4b4a-b612-2b5292f31597]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c3fa8-12cc-4da6-a186-8b5dd52da226]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:41:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:41:16 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:41:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07f058-29ca-4a17-a906-cf922cc2eba8]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:41:17 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:41:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23337636133373137', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337636133373137', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG nova.objects.instance [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:41:18 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:41:18 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:41:18 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:41:18 user nova-compute[75097]:   <serial>4cb6d50b-60b4-435c-9aca-7f46cbfe5870</serial>
Nov 14 16:41:18 user nova-compute[75097]: </disk>
Nov 14 16:41:18 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No VIF found with MAC fa:16:3e:ec:26:9c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:41:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-601f09d4-029b-4515-98a1-bb7653cbdc84 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.177s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75097) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG nova.objects.instance [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-5bc1eab3-c04f-4ccc-b404-4c298bb92a1e req-d1a4cc2b-923e-40ef-9fdb-c9226eec6720 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5bc1eab3-c04f-4ccc-b404-4c298bb92a1e req-d1a4cc2b-923e-40ef-9fdb-c9226eec6720 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5bc1eab3-c04f-4ccc-b404-4c298bb92a1e req-d1a4cc2b-923e-40ef-9fdb-c9226eec6720 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5bc1eab3-c04f-4ccc-b404-4c298bb92a1e req-d1a4cc2b-923e-40ef-9fdb-c9226eec6720 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-5bc1eab3-c04f-4ccc-b404-4c298bb92a1e req-d1a4cc2b-923e-40ef-9fdb-c9226eec6720 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:41:19 user nova-compute[75097]: WARNING nova.compute.manager [req-5bc1eab3-c04f-4ccc-b404-4c298bb92a1e req-d1a4cc2b-923e-40ef-9fdb-c9226eec6720 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state active and task_state powering-off.
Nov 14 16:41:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:19 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance destroyed successfully.
Nov 14 16:41:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:41:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-2f34f647-1222-46a1-a295-2a422d14479a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.844s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-a46a4e2e-49d5-460d-a1d1-c76c9e422489 req-411cca01-1968-4064-9d1d-b70cf00b10b9 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:41:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a46a4e2e-49d5-460d-a1d1-c76c9e422489 req-411cca01-1968-4064-9d1d-b70cf00b10b9 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:41:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a46a4e2e-49d5-460d-a1d1-c76c9e422489 req-411cca01-1968-4064-9d1d-b70cf00b10b9 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:41:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a46a4e2e-49d5-460d-a1d1-c76c9e422489 req-411cca01-1968-4064-9d1d-b70cf00b10b9 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:41:21 user nova-compute[75097]: DEBUG nova.compute.manager [req-a46a4e2e-49d5-460d-a1d1-c76c9e422489 req-411cca01-1968-4064-9d1d-b70cf00b10b9 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:41:21 user nova-compute[75097]: WARNING nova.compute.manager [req-a46a4e2e-49d5-460d-a1d1-c76c9e422489 req-411cca01-1968-4064-9d1d-b70cf00b10b9 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state stopped and task_state None.
Nov 14 16:41:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:41:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:41:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:41:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:41:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:41:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:41:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:41:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:41:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:41:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:41:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:41:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:41:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:07 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:07 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:42:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:42:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:42:07 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:42:08 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:42:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:42:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:42:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:42:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=24.968826293945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:42:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:42:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:42:13 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:42:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:42:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:18 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:42:26 user nova-compute[75097]: INFO nova.compute.claims [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Claim successful on node user
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:42:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.policy [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67d61b9fe7364340858dd2ac7b3d3620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5216e7a2fb437885d659f01c9d220c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:42:26 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Creating image(s)
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "/opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "/opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk 1073741824" returned: 0 in 0.051s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Successfully created port: 9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Cannot resize image /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Ensure instance console log exists: /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Successfully updated port: 9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquired lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-changed-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Refreshing instance network info cache due to event network-changed-9054a525-cb75-4ece-9c46-641a6482bf67. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] Acquiring lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Releasing lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Instance network_info: |[{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] Acquired lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.network.neutron [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Refreshing network info cache for port 9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Start _get_guest_xml network_info=[{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:42:27 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:42:27 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:42:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1013679169',display_name='tempest-SnapshotDataIntegrityTests-server-1013679169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1013679169',id=49,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+weR5PmjyOFEacMQfZUrvkko2mRo+CYYvbzTWAPNOBiDybKDdW6GVPvFUFVGYMF83cLWsnPvFyGjgFosLpRxM/MG44DcxSFqvgYq6xjw0y4Pduho+67BaJRXFrshrP6g==',key_name='tempest-keypair-1447085410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5216e7a2fb437885d659f01c9d220c',ramdisk_id='',reservation_id='r-3wlxvazh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-912677661',owner_user_name='tempest-SnapshotDataIntegrityTests-912677661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d61b9fe7364340858dd2ac7b3d3620',uuid=d2aee97c-9776-4160-9911-2b4d6e76a260,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Converting VIF {"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'pci_devices' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:42:28 user nova-compute[75097]:   <uuid>d2aee97c-9776-4160-9911-2b4d6e76a260</uuid>
Nov 14 16:42:28 user nova-compute[75097]:   <name>instance-00000031</name>
Nov 14 16:42:28 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:42:28 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:42:28 user nova-compute[75097]:   <metadata>
Nov 14 16:42:28 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:42:28 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:42:28 user nova-compute[75097]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1013679169</nova:name>
Nov 14 16:42:28 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:42:27</nova:creationTime>
Nov 14 16:42:28 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:42:28 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:42:28 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:42:28 user nova-compute[75097]:       <nova:owner>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:user uuid="67d61b9fe7364340858dd2ac7b3d3620">tempest-SnapshotDataIntegrityTests-912677661-project-member</nova:user>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:project uuid="7b5216e7a2fb437885d659f01c9d220c">tempest-SnapshotDataIntegrityTests-912677661</nova:project>
Nov 14 16:42:28 user nova-compute[75097]:       </nova:owner>
Nov 14 16:42:28 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:42:28 user nova-compute[75097]:       <nova:ports>
Nov 14 16:42:28 user nova-compute[75097]:         <nova:port uuid="9054a525-cb75-4ece-9c46-641a6482bf67">
Nov 14 16:42:28 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 16:42:28 user nova-compute[75097]:         </nova:port>
Nov 14 16:42:28 user nova-compute[75097]:       </nova:ports>
Nov 14 16:42:28 user nova-compute[75097]:     </nova:instance>
Nov 14 16:42:28 user nova-compute[75097]:   </metadata>
Nov 14 16:42:28 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:42:28 user nova-compute[75097]:     <system>
Nov 14 16:42:28 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:42:28 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:42:28 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:42:28 user nova-compute[75097]:       <entry name="serial">d2aee97c-9776-4160-9911-2b4d6e76a260</entry>
Nov 14 16:42:28 user nova-compute[75097]:       <entry name="uuid">d2aee97c-9776-4160-9911-2b4d6e76a260</entry>
Nov 14 16:42:28 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:42:28 user nova-compute[75097]:     </system>
Nov 14 16:42:28 user nova-compute[75097]:   </sysinfo>
Nov 14 16:42:28 user nova-compute[75097]:   <os>
Nov 14 16:42:28 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:42:28 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:42:28 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:42:28 user nova-compute[75097]:   </os>
Nov 14 16:42:28 user nova-compute[75097]:   <features>
Nov 14 16:42:28 user nova-compute[75097]:     <acpi/>
Nov 14 16:42:28 user nova-compute[75097]:     <apic/>
Nov 14 16:42:28 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:42:28 user nova-compute[75097]:   </features>
Nov 14 16:42:28 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:42:28 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:42:28 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:42:28 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:42:28 user nova-compute[75097]:   </clock>
Nov 14 16:42:28 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:42:28 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:42:28 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:42:28 user nova-compute[75097]:   </cpu>
Nov 14 16:42:28 user nova-compute[75097]:   <devices>
Nov 14 16:42:28 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:42:28 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:42:28 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk"/>
Nov 14 16:42:28 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:42:28 user nova-compute[75097]:     </disk>
Nov 14 16:42:28 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:42:28 user nova-compute[75097]:       <mac address="fa:16:3e:88:4d:02"/>
Nov 14 16:42:28 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:42:28 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:42:28 user nova-compute[75097]:       <target dev="tap9054a525-cb"/>
Nov 14 16:42:28 user nova-compute[75097]:     </interface>
Nov 14 16:42:28 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:42:28 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/console.log" append="off"/>
Nov 14 16:42:28 user nova-compute[75097]:     </serial>
Nov 14 16:42:28 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:42:28 user nova-compute[75097]:     <video>
Nov 14 16:42:28 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:42:28 user nova-compute[75097]:     </video>
Nov 14 16:42:28 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:42:28 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:42:28 user nova-compute[75097]:     </rng>
Nov 14 16:42:28 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:42:28 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:42:28 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:42:28 user nova-compute[75097]:     </memballoon>
Nov 14 16:42:28 user nova-compute[75097]:   </devices>
Nov 14 16:42:28 user nova-compute[75097]: </domain>
Nov 14 16:42:28 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1013679169',display_name='tempest-SnapshotDataIntegrityTests-server-1013679169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1013679169',id=49,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+weR5PmjyOFEacMQfZUrvkko2mRo+CYYvbzTWAPNOBiDybKDdW6GVPvFUFVGYMF83cLWsnPvFyGjgFosLpRxM/MG44DcxSFqvgYq6xjw0y4Pduho+67BaJRXFrshrP6g==',key_name='tempest-keypair-1447085410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b5216e7a2fb437885d659f01c9d220c',ramdisk_id='',reservation_id='r-3wlxvazh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-912677661',owner_user_name='tempest-SnapshotDataIntegrityTests-912677661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:42:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d61b9fe7364340858dd2ac7b3d3620',uuid=d2aee97c-9776-4160-9911-2b4d6e76a260,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Converting VIF {"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG os_vif [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed92ee41-cf79-58b6-bbc5-dd347bfe2d37', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9054a525-cb, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9054a525-cb, col_values=(('qos', UUID('a3e9367d-2e2c-4d6e-9179-23bd02dcb168')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9054a525-cb, col_values=(('external_ids', {'iface-id': '9054a525-cb75-4ece-9c46-641a6482bf67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:4d:02', 'vm-uuid': 'd2aee97c-9776-4160-9911-2b4d6e76a260'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:28 user nova-compute[75097]: INFO os_vif [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb')
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No VIF found with MAC fa:16:3e:88:4d:02, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.network.neutron [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updated VIF entry in instance network info cache for port 9054a525-cb75-4ece-9c46-641a6482bf67. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG nova.network.neutron [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:42:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-245f4679-81e5-4657-bc22-1390463d9572 req-619788e3-78e3-4419-9e10-a922cf4a4ef4 service nova] Releasing lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-92dc96dd-b3e9-4ffb-b535-4883b768b3f7 req-6b196f8d-9823-44fc-9a97-7684fbca1be2 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-92dc96dd-b3e9-4ffb-b535-4883b768b3f7 req-6b196f8d-9823-44fc-9a97-7684fbca1be2 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-92dc96dd-b3e9-4ffb-b535-4883b768b3f7 req-6b196f8d-9823-44fc-9a97-7684fbca1be2 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-92dc96dd-b3e9-4ffb-b535-4883b768b3f7 req-6b196f8d-9823-44fc-9a97-7684fbca1be2 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-92dc96dd-b3e9-4ffb-b535-4883b768b3f7 req-6b196f8d-9823-44fc-9a97-7684fbca1be2 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:42:29 user nova-compute[75097]: WARNING nova.compute.manager [req-92dc96dd-b3e9-4ffb-b535-4883b768b3f7 req-6b196f8d-9823-44fc-9a97-7684fbca1be2 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state building and task_state spawning.
Nov 14 16:42:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:42:31 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Instance spawned successfully.
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:42:31 user nova-compute[75097]: INFO nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:42:31 user nova-compute[75097]: INFO nova.compute.manager [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Took 5.54 seconds to build instance.
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-8177356d-c682-453e-88c1-f091cb697b6a req-34c88e0a-e654-49ba-9066-af8ce991f24d service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8177356d-c682-453e-88c1-f091cb697b6a req-34c88e0a-e654-49ba-9066-af8ce991f24d service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8177356d-c682-453e-88c1-f091cb697b6a req-34c88e0a-e654-49ba-9066-af8ce991f24d service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-8177356d-c682-453e-88c1-f091cb697b6a req-34c88e0a-e654-49ba-9066-af8ce991f24d service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-8177356d-c682-453e-88c1-f091cb697b6a req-34c88e0a-e654-49ba-9066-af8ce991f24d service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:42:31 user nova-compute[75097]: WARNING nova.compute.manager [req-8177356d-c682-453e-88c1-f091cb697b6a req-34c88e0a-e654-49ba-9066-af8ce991f24d service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state active and task_state None.
Nov 14 16:42:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-b7b398f6-3d89-498e-a721-977f29419a53 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.644s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:42:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:42:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:42:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:42:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:42:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:42:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:42:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:43:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:43:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:43:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:43:09 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'info_cache' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.network.neutron [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:43:10 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance destroyed successfully.
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'resources' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c4d4bcd-26, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a75b8abb-cfeb-45e0-b7d5-b57cf62ef94c) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:10 user nova-compute[75097]: INFO os_vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26')
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:43:10 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f4804-d417-4e14-a963-17084713309d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:43:10 user nova-compute[75097]: No targets found.
Nov 14 16:43:10 user nova-compute[75097]: iSNS:
Nov 14 16:43:10 user nova-compute[75097]: No targets found.
Nov 14 16:43:10 user nova-compute[75097]: STATIC:
Nov 14 16:43:10 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870
Nov 14 16:43:10 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:43:10 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:43:10 user nova-compute[75097]: FIRMWARE:
Nov 14 16:43:10 user nova-compute[75097]: No targets found.
Nov 14 16:43:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:43:10 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:43:10 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e38f4f-6e37-4419-857b-75beff216532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86bd1b-0d2b-4d03-8c56-919249e5c7b9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:43:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:43:10 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf981d4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:43:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:43:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=24.93826675415039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a13d72-e650-4b80-8fbe-730d92fcb568]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aa034d-b0ef-4bc3-abde-6341f8fec872]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ae9e9e-894f-4001-b4ca-0be97f315646]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d2aee97c-9776-4160-9911-2b4d6e76a260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[16069020-a4e0-4bb4-9256-3b57e0a2da61]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a475495-8f15-4a0f-81c7-ec54367f21c0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f2b32-99c9-4782-a627-2e092ebb2355]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]
Nov 14 16:43:11 user nova-compute[75097]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.
Nov 14 16:43:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2677d5db-5db9-4d31-b6dc-cd45e1d9a004]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.616s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== disconnect_volume: return (618ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start _get_guest_xml network_info=[{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a56a42be-8543-402d-928b-fca06198cec7', 'attached_at': '', 'detached_at': '', 'volume_id': '4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'serial': '4cb6d50b-60b4-435c-9aca-7f46cbfe5870'}, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '1dfc700b-a24a-44b6-bef0-041ea1af4529', 'volume_type': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'numa_topology' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:11 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:43:11 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'vcpu_model' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:43:11 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:43:11 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:43:11 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[73950e8d-f4f3-4ebb-b203-96d32fb9840f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:43:11 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f715ca0d-7042-4d97-a1e0-4dbf95261e43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870] added
Nov 14 16:43:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[93241024-01db-4279-98f0-6d8c54f29f5c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50038f-bda5-4ce5-8261-9d170e4f8129]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eoRpIgtP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eoRpIgtP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24946c5-3ac0-41b2-8653-179761c25868]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eoRpIgtP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba1703-a402-4607-9c7d-0163249bfff6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[116190af-88c0-4ca0-b9f8-8af8c0100948]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:43:11 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:43:11 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:43:11 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:43:11 user nova-compute[75097]: 
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe30366e-5d40-4a69-8d23-07b3e132d2ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]
Nov 14 16:43:11 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.
Nov 14 16:43:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e85f3-e435-49c2-868a-002e4a3c319e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb7536d-3fa5-43c8-b232-f0b34def5f7c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:43:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:43:11 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d69d7bb-ea18-48a1-9563-45107bbe8678]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:43:11 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23337636133373137', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337636133373137', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'pci_devices' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:43:12 user nova-compute[75097]:   <uuid>a56a42be-8543-402d-928b-fca06198cec7</uuid>
Nov 14 16:43:12 user nova-compute[75097]:   <name>instance-00000030</name>
Nov 14 16:43:12 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:43:12 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:43:12 user nova-compute[75097]:   <metadata>
Nov 14 16:43:12 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:43:12 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:43:12 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeTestJSON-server-1449290610</nova:name>
Nov 14 16:43:12 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:43:11</nova:creationTime>
Nov 14 16:43:12 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:43:12 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:43:12 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:43:12 user nova-compute[75097]:       <nova:owner>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:user uuid="e789fb8ecb2a4113aa3ad4e60f802cea">tempest-AttachVolumeTestJSON-350193510-project-member</nova:user>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:project uuid="4686cf09fac24c94b6cbc8b7f43c474c">tempest-AttachVolumeTestJSON-350193510</nova:project>
Nov 14 16:43:12 user nova-compute[75097]:       </nova:owner>
Nov 14 16:43:12 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:43:12 user nova-compute[75097]:       <nova:ports>
Nov 14 16:43:12 user nova-compute[75097]:         <nova:port uuid="2c4d4bcd-2658-498a-b41a-0b28762c2210">
Nov 14 16:43:12 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:43:12 user nova-compute[75097]:         </nova:port>
Nov 14 16:43:12 user nova-compute[75097]:       </nova:ports>
Nov 14 16:43:12 user nova-compute[75097]:     </nova:instance>
Nov 14 16:43:12 user nova-compute[75097]:   </metadata>
Nov 14 16:43:12 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:43:12 user nova-compute[75097]:     <system>
Nov 14 16:43:12 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:43:12 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:43:12 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:43:12 user nova-compute[75097]:       <entry name="serial">a56a42be-8543-402d-928b-fca06198cec7</entry>
Nov 14 16:43:12 user nova-compute[75097]:       <entry name="uuid">a56a42be-8543-402d-928b-fca06198cec7</entry>
Nov 14 16:43:12 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:43:12 user nova-compute[75097]:     </system>
Nov 14 16:43:12 user nova-compute[75097]:   </sysinfo>
Nov 14 16:43:12 user nova-compute[75097]:   <os>
Nov 14 16:43:12 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:43:12 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:43:12 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:43:12 user nova-compute[75097]:   </os>
Nov 14 16:43:12 user nova-compute[75097]:   <features>
Nov 14 16:43:12 user nova-compute[75097]:     <acpi/>
Nov 14 16:43:12 user nova-compute[75097]:     <apic/>
Nov 14 16:43:12 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:43:12 user nova-compute[75097]:   </features>
Nov 14 16:43:12 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:43:12 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:43:12 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:43:12 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:43:12 user nova-compute[75097]:   </clock>
Nov 14 16:43:12 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:43:12 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:43:12 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:43:12 user nova-compute[75097]:   </cpu>
Nov 14 16:43:12 user nova-compute[75097]:   <devices>
Nov 14 16:43:12 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:43:12 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:43:12 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk"/>
Nov 14 16:43:12 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:43:12 user nova-compute[75097]:     </disk>
Nov 14 16:43:12 user nova-compute[75097]:     <disk type="block" device="disk">
Nov 14 16:43:12 user nova-compute[75097]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:43:12 user nova-compute[75097]:       <source dev="/dev/sdb"/>
Nov 14 16:43:12 user nova-compute[75097]:       <target dev="vdb" bus="virtio"/>
Nov 14 16:43:12 user nova-compute[75097]:       <serial>4cb6d50b-60b4-435c-9aca-7f46cbfe5870</serial>
Nov 14 16:43:12 user nova-compute[75097]:     </disk>
Nov 14 16:43:12 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:43:12 user nova-compute[75097]:       <mac address="fa:16:3e:ec:26:9c"/>
Nov 14 16:43:12 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:43:12 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:43:12 user nova-compute[75097]:       <target dev="tap2c4d4bcd-26"/>
Nov 14 16:43:12 user nova-compute[75097]:     </interface>
Nov 14 16:43:12 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:43:12 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/console.log" append="off"/>
Nov 14 16:43:12 user nova-compute[75097]:     </serial>
Nov 14 16:43:12 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:43:12 user nova-compute[75097]:     <video>
Nov 14 16:43:12 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:43:12 user nova-compute[75097]:     </video>
Nov 14 16:43:12 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:43:12 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:43:12 user nova-compute[75097]:     </rng>
Nov 14 16:43:12 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:43:12 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:43:12 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:43:12 user nova-compute[75097]:     </memballoon>
Nov 14 16:43:12 user nova-compute[75097]:   </devices>
Nov 14 16:43:12 user nova-compute[75097]: </domain>
Nov 14 16:43:12 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'trusted_certs' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Cannot resize image /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.objects.instance [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'migration_context' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.objects.base [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG os_vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b83223a-c531-5c90-a94a-8941a499f866', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c4d4bcd-26, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c4d4bcd-26, col_values=(('qos', UUID('44a535b1-b641-466b-8491-7e2bd148f6ca')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c4d4bcd-26, col_values=(('external_ids', {'iface-id': '2c4d4bcd-2658-498a-b41a-0b28762c2210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:26:9c', 'vm-uuid': 'a56a42be-8543-402d-928b-fca06198cec7'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:13 user nova-compute[75097]: INFO os_vif [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26')
Nov 14 16:43:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-7ece9bb3-8098-4147-86a7-6f8e04fc955e req-51f7ea1c-0dba-4396-aae9-46c817098858 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7ece9bb3-8098-4147-86a7-6f8e04fc955e req-51f7ea1c-0dba-4396-aae9-46c817098858 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7ece9bb3-8098-4147-86a7-6f8e04fc955e req-51f7ea1c-0dba-4396-aae9-46c817098858 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-7ece9bb3-8098-4147-86a7-6f8e04fc955e req-51f7ea1c-0dba-4396-aae9-46c817098858 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:43:14 user nova-compute[75097]: DEBUG nova.compute.manager [req-7ece9bb3-8098-4147-86a7-6f8e04fc955e req-51f7ea1c-0dba-4396-aae9-46c817098858 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:43:14 user nova-compute[75097]: WARNING nova.compute.manager [req-7ece9bb3-8098-4147-86a7-6f8e04fc955e req-51f7ea1c-0dba-4396-aae9-46c817098858 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state stopped and task_state powering-on.
Nov 14 16:43:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:43:16 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance rebooted successfully.
Nov 14 16:43:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-17cf1b50-60b4-4887-bed8-a19e92351e9c tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:43:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-ff220138-d7b1-4706-887b-525e3c286674 req-56f64a5b-6ecd-40fe-90de-5bc011493521 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:43:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ff220138-d7b1-4706-887b-525e3c286674 req-56f64a5b-6ecd-40fe-90de-5bc011493521 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:43:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ff220138-d7b1-4706-887b-525e3c286674 req-56f64a5b-6ecd-40fe-90de-5bc011493521 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:43:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-ff220138-d7b1-4706-887b-525e3c286674 req-56f64a5b-6ecd-40fe-90de-5bc011493521 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:43:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-ff220138-d7b1-4706-887b-525e3c286674 req-56f64a5b-6ecd-40fe-90de-5bc011493521 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:43:16 user nova-compute[75097]: WARNING nova.compute.manager [req-ff220138-d7b1-4706-887b-525e3c286674 req-56f64a5b-6ecd-40fe-90de-5bc011493521 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state stopped and task_state powering-on.
Nov 14 16:43:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:18 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:43:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:43:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:43:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:43:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:43:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:43:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:09 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:44:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:44:10 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=24.936782836914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d2aee97c-9776-4160-9911-2b4d6e76a260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:44:10 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:44:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:44:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:44:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:44:12 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:44:13 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:44:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:44:13 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:44:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:44:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:15 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:44:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-changed-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:44:16 user nova-compute[75097]: DEBUG nova.compute.manager [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Refreshing instance network info cache due to event network-changed-9054a525-cb75-4ece-9c46-641a6482bf67. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:44:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] Acquiring lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:44:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] Acquired lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:44:16 user nova-compute[75097]: DEBUG nova.network.neutron [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Refreshing network info cache for port 9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:44:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updated VIF entry in instance network info cache for port 9054a525-cb75-4ece-9c46-641a6482bf67. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:44:17 user nova-compute[75097]: DEBUG nova.network.neutron [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:44:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-bafb048a-01ec-44fd-bab5-13526291eaac req-c88c7199-13a5-4b46-bfd8-a95d182afd60 service nova] Releasing lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:44:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:44:19 user nova-compute[75097]: INFO nova.compute.manager [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attaching volume bf931c05-21fa-415b-96b3-cc4edc7ff29c to /dev/vdb
Nov 14 16:44:19 user nova-compute[75097]: DEBUG os_brick.utils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204f935-a24e-4f96-a32d-e60e9dd1fcb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a4e19-5c10-4a28-8ec3-161fb8b74cf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3cd549-046d-4754-b046-e6f1b71f20f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d274b-b1d3-42f6-9fdb-a7a18e1f62e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:44:19 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:44:19 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8c7301-39e5-400a-b797-4fa8f4cef0de]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG os_brick.utils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:44:19 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating existing volume attachment record: ae2c0931-aae0-4677-a878-175269cc1bdf {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:44:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:44:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msTnQUeF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:44:23 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:44:23 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:44:23 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a3202b-4c30-4b7d-b65d-993cd0a0e29a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:44:23 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac399e0-e79e-4264-a1cc-d80b67491ef6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c] added
Nov 14 16:44:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5cd7e-a89f-4c70-bbfc-4da5debe46cb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f3354-70c1-4ec7-af4f-f421ea2cb866]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msTnQUeF {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msTnQUeF" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[34195302-3a31-474c-bcd1-128b80fe9861]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msTnQUeF'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e92cb-1a00-41a5-ab68-565511e55bff]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[26804297-1367-4d41-b766-020f966e54c1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:44:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:44:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[95884c4a-9b80-4b49-84a6-abfa94d8b4b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260]
Nov 14 16:44:23 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260] successful.
Nov 14 16:44:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8680f7-779b-47dc-84b5-a29d19090353]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c426ca65-44be-4ba7-a6c8-34ff1a24a16c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:44:23 user nova-compute[75097]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c (non-flash)
Nov 14 16:44:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:44:23 user nova-compute[75097]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c (non-flash)
Nov 14 16:44:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:44:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4349b-b2c4-40e6-ae58-f471607779c0]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:44:24 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msTnQUeF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23633353830623930', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633353830623930', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:44:25 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:44:25 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:44:25 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:44:25 user nova-compute[75097]:   <serial>bf931c05-21fa-415b-96b3-cc4edc7ff29c</serial>
Nov 14 16:44:25 user nova-compute[75097]: </disk>
Nov 14 16:44:25 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No VIF found with MAC fa:16:3e:88:4d:02, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:44:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-f77f5b36-bb34-4ebe-9815-ffa781701b9f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.349s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:44:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:44:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:44:32 user nova-compute[75097]: INFO nova.compute.manager [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Detaching volume bf931c05-21fa-415b-96b3-cc4edc7ff29c
Nov 14 16:44:32 user nova-compute[75097]: INFO nova.virt.block_device [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attempting to driver detach volume bf931c05-21fa-415b-96b3-cc4edc7ff29c from mountpoint /dev/vdb
Nov 14 16:44:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Attempting to detach device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:44:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:44:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:44:32 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:44:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:44:32 user nova-compute[75097]:   <serial>bf931c05-21fa-415b-96b3-cc4edc7ff29c</serial>
Nov 14 16:44:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:44:32 user nova-compute[75097]: </disk>
Nov 14 16:44:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:44:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config.
Nov 14 16:44:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:44:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:44:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:44:32 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:44:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:44:32 user nova-compute[75097]:   <serial>bf931c05-21fa-415b-96b3-cc4edc7ff29c</serial>
Nov 14 16:44:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:44:32 user nova-compute[75097]: </disk>
Nov 14 16:44:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:44:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:44:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:44:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:53 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 is timed out.
Nov 14 16:44:53 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config.
Nov 14 16:44:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msTnQUeF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:44:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8b7872-208f-4b4d-b961-7858333b8f31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:44:53 user nova-compute[75097]: No targets found.
Nov 14 16:44:53 user nova-compute[75097]: iSNS:
Nov 14 16:44:53 user nova-compute[75097]: No targets found.
Nov 14 16:44:53 user nova-compute[75097]: STATIC:
Nov 14 16:44:53 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c
Nov 14 16:44:53 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:44:53 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:44:53 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870
Nov 14 16:44:53 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:44:53 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:44:53 user nova-compute[75097]: FIRMWARE:
Nov 14 16:44:53 user nova-compute[75097]: No targets found.
Nov 14 16:44:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:44:53 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:44:53 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fede0da1-998a-4d00-bbbb-f5956ce4bcef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[95734cd8-c86b-4cca-b2d6-091077274444]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:44:53 user nova-compute[75097]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c (non-flash)
Nov 14 16:44:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:44:53 user nova-compute[75097]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c (non-flash)
Nov 14 16:44:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf78555fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[016281c8-54af-4a2e-bccb-ff60d02c79b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42741fcf-b0d7-47a7-be2d-a50804cfc989]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181531d-c34f-4886-9c65-0b5b1c77a0f8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312a0c5-f964-46bf-92fb-02708f2f330f]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4639eb-cbc1-490b-829c-6b62e0026549]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c833fc-816d-4301-b924-8c2a65357c0f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260]
Nov 14 16:44:53 user nova-compute[75097]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c, portal: 172.16.0.220,3260] successful.
Nov 14 16:44:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf931c05-21fa-415b-96b3-cc4edc7ff29c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6025f7d9-4d7e-470a-8b58-bc360ad9722e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== disconnect_volume: return (293ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:44:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:44:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:44:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-210b943e-6b2b-49ab-98a3-6792b3b7dc5f tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:44:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:45:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:01 user nova-compute[75097]: INFO nova.compute.manager [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Detaching volume 4cb6d50b-60b4-435c-9aca-7f46cbfe5870
Nov 14 16:45:01 user nova-compute[75097]: INFO nova.virt.block_device [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Attempting to driver detach volume 4cb6d50b-60b4-435c-9aca-7f46cbfe5870 from mountpoint /dev/vdb
Nov 14 16:45:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Attempting to detach device vdb from instance a56a42be-8543-402d-928b-fca06198cec7 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:45:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:45:01 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:45:01 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:45:01 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:45:01 user nova-compute[75097]:   <serial>4cb6d50b-60b4-435c-9aca-7f46cbfe5870</serial>
Nov 14 16:45:01 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:45:01 user nova-compute[75097]: </disk>
Nov 14 16:45:01 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:45:01 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully detached device vdb from instance a56a42be-8543-402d-928b-fca06198cec7 from the persistent domain config.
Nov 14 16:45:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a56a42be-8543-402d-928b-fca06198cec7 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:45:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:45:01 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:45:01 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:45:01 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:45:01 user nova-compute[75097]:   <serial>4cb6d50b-60b4-435c-9aca-7f46cbfe5870</serial>
Nov 14 16:45:01 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 16:45:01 user nova-compute[75097]: </disk>
Nov 14 16:45:01 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:45:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:45:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:45:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=24.935344696044922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d2aee97c-9776-4160-9911-2b4d6e76a260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:45:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:45:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:45:15 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:45:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:45:15 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:45:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:45:18 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:21 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a56a42be-8543-402d-928b-fca06198cec7 is timed out.
Nov 14 16:45:21 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully detached device vdb from instance a56a42be-8543-402d-928b-fca06198cec7 from the live domain config.
Nov 14 16:45:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eoRpIgtP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:45:21 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd13ddf-2adb-420d-847f-6ebfd103697b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:45:21 user nova-compute[75097]: No targets found.
Nov 14 16:45:21 user nova-compute[75097]: iSNS:
Nov 14 16:45:21 user nova-compute[75097]: No targets found.
Nov 14 16:45:21 user nova-compute[75097]: STATIC:
Nov 14 16:45:21 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870
Nov 14 16:45:21 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:45:21 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:45:21 user nova-compute[75097]: FIRMWARE:
Nov 14 16:45:21 user nova-compute[75097]: No targets found.
Nov 14 16:45:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:45:21 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:45:21 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac50234-b30b-489f-b000-c7b0f5591db2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d930e-61e5-4b8a-8ad3-422145297f40]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:45:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 (non-flash)
Nov 14 16:45:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[798ea104-4f8b-4789-9247-4065984038dc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d8c14f-cf61-48fa-8300-9e6ee8dd3383]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04e3a9f-3f49-461a-b3d4-ecccd4f79e56]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ee542-8e04-45a8-b2e5-28faee816235]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8cc307-f088-429e-b87b-f02c961e5c7d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bc9666-5347-4edc-ab0a-bb016a207468]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260]
Nov 14 16:45:21 user nova-compute[75097]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870, portal: 172.16.0.220,3260] successful.
Nov 14 16:45:21 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cb6d50b-60b4-435c-9aca-7f46cbfe5870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c91436-7603-42d3-b13c-156d02827c9a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== disconnect_volume: return (283ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:45:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:45:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:45:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ddb9f33a-afc9-442f-b941-84fb50e7f3b5 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75097) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG nova.objects.instance [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-d3412bf4-5cbf-48fd-a6d6-a4dae3e49344 req-06db5f2b-1d6a-4930-a71f-7b0064666199 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d3412bf4-5cbf-48fd-a6d6-a4dae3e49344 req-06db5f2b-1d6a-4930-a71f-7b0064666199 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d3412bf4-5cbf-48fd-a6d6-a4dae3e49344 req-06db5f2b-1d6a-4930-a71f-7b0064666199 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d3412bf4-5cbf-48fd-a6d6-a4dae3e49344 req-06db5f2b-1d6a-4930-a71f-7b0064666199 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:23 user nova-compute[75097]: DEBUG nova.compute.manager [req-d3412bf4-5cbf-48fd-a6d6-a4dae3e49344 req-06db5f2b-1d6a-4930-a71f-7b0064666199 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:45:23 user nova-compute[75097]: WARNING nova.compute.manager [req-d3412bf4-5cbf-48fd-a6d6-a4dae3e49344 req-06db5f2b-1d6a-4930-a71f-7b0064666199 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state active and task_state powering-off.
Nov 14 16:45:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:24 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance destroyed successfully.
Nov 14 16:45:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-8b7be6df-9a89-4ebb-99d2-ebee64a34302 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.924s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:24 user nova-compute[75097]: INFO nova.compute.manager [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attaching volume 201afcd7-60ba-4b46-9460-53563b9d4d71 to /dev/vdb
Nov 14 16:45:24 user nova-compute[75097]: DEBUG os_brick.utils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f18068d-d1ef-46b0-ad29-4ff3b00c4009]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[870be6d3-41ed-43b2-ab14-fa8a706342eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9841219-a3d3-448f-8e20-b92445024a58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70ae8f-f728-49a2-ab5b-8246b15e6482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:45:25 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece6f26-bac7-4c8a-a3ea-03213e103930]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating existing volume attachment record: b0d3fe6c-840a-4b01-8b86-8b99ea0f8a24 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-39d39b57-d3a7-42ad-9b41-412f0f150aae req-7766afa8-b67d-4e23-9135-ab57a4843672 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-39d39b57-d3a7-42ad-9b41-412f0f150aae req-7766afa8-b67d-4e23-9135-ab57a4843672 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-39d39b57-d3a7-42ad-9b41-412f0f150aae req-7766afa8-b67d-4e23-9135-ab57a4843672 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-39d39b57-d3a7-42ad-9b41-412f0f150aae req-7766afa8-b67d-4e23-9135-ab57a4843672 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-39d39b57-d3a7-42ad-9b41-412f0f150aae req-7766afa8-b67d-4e23-9135-ab57a4843672 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:45:25 user nova-compute[75097]: WARNING nova.compute.manager [req-39d39b57-d3a7-42ad-9b41-412f0f150aae req-7766afa8-b67d-4e23-9135-ab57a4843672 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state stopped and task_state None.
Nov 14 16:45:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twMmNPcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:45:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:45:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:45:29 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aafa8ee-07ba-4ba9-943d-c22b71fd2557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:45:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a581ccf-a207-4e44-9584-bf1d011d2baa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71] added
Nov 14 16:45:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad0115f-cec1-4309-90e3-4a0274675905]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9f6cbe-d3ef-493d-8eec-8fcb8e118201]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twMmNPcI {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v twMmNPcI" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6a0ca-3b4f-47ff-a366-2b5b465686c4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'twMmNPcI'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53db796-5532-452c-b1f1-3dc3e6f0f146]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533926f-ae76-4dd5-b787-554c785c29df]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:45:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:45:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:45:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:45:29 user nova-compute[75097]: 
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ddb4b7-e9d7-4d06-b56b-91d7c3449420]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260]
Nov 14 16:45:29 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260] successful.
Nov 14 16:45:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0396d35-9a40-46fc-befe-8a0c53cccf39]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b48d69-8ec0-4ee2-aba6-08a55f5f61a0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 (non-flash)
Nov 14 16:45:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 (non-flash)
Nov 14 16:45:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4e0026-1ab2-49c6-af7b-0f61d131668c]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:45:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twMmNPcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23630346636626364', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630346636626364', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:45:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:45:30 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:45:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:45:30 user nova-compute[75097]:   <serial>201afcd7-60ba-4b46-9460-53563b9d4d71</serial>
Nov 14 16:45:30 user nova-compute[75097]: </disk>
Nov 14 16:45:30 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No VIF found with MAC fa:16:3e:88:4d:02, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:45:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-14844ff8-54e0-48a6-aabe-e083c4265176 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.057s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:45:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:45:32 user nova-compute[75097]: INFO nova.compute.manager [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Detaching volume 201afcd7-60ba-4b46-9460-53563b9d4d71
Nov 14 16:45:32 user nova-compute[75097]: INFO nova.virt.block_device [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attempting to driver detach volume 201afcd7-60ba-4b46-9460-53563b9d4d71 from mountpoint /dev/vdb
Nov 14 16:45:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Attempting to detach device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:45:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:45:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:45:32 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:45:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:45:32 user nova-compute[75097]:   <serial>201afcd7-60ba-4b46-9460-53563b9d4d71</serial>
Nov 14 16:45:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:45:32 user nova-compute[75097]: </disk>
Nov 14 16:45:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:45:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config.
Nov 14 16:45:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:45:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:45:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:45:32 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:45:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:45:32 user nova-compute[75097]:   <serial>201afcd7-60ba-4b46-9460-53563b9d4d71</serial>
Nov 14 16:45:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:45:32 user nova-compute[75097]: </disk>
Nov 14 16:45:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:45:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:45:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:45:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:45:53 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 is timed out.
Nov 14 16:45:53 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config.
Nov 14 16:45:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'twMmNPcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:45:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddafd7b-6952-4da0-b13d-da2527ec46ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:45:53 user nova-compute[75097]: No targets found.
Nov 14 16:45:53 user nova-compute[75097]: iSNS:
Nov 14 16:45:53 user nova-compute[75097]: No targets found.
Nov 14 16:45:53 user nova-compute[75097]: STATIC:
Nov 14 16:45:53 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71
Nov 14 16:45:53 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:45:53 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:45:53 user nova-compute[75097]: FIRMWARE:
Nov 14 16:45:53 user nova-compute[75097]: No targets found.
Nov 14 16:45:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:45:53 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:45:53 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a558f-992f-42e8-8d13-a4e43da0be51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8cba9c-0bdd-4bfd-9710-fc0493b2f74c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 (non-flash)
Nov 14 16:45:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 (non-flash)
Nov 14 16:45:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf78705ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e7c5c-5148-43ed-9c46-7e23b7a0e115]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1452b-8c8e-40d8-a17e-55b3a032422d]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4439e6-9df3-4c70-bc3f-45919e35a81e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62f1344-d9aa-4dea-b79c-94bc10ee39de]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e870fb05-fdb1-4508-a231-eaa7622b7968]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b024e3f4-869b-4eb4-bc96-f1efb2f38ab5]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260]
Nov 14 16:45:53 user nova-compute[75097]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71, portal: 172.16.0.220,3260] successful.
Nov 14 16:45:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201afcd7-60ba-4b46-9460-53563b9d4d71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b4b10e-04e5-46d1-bb14-e078d03ccf52]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== disconnect_volume: return (285ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:45:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:45:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:45:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d1e518a1-57a2-47c8-9205-66ad3b2d9239 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:45:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:46:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=24.93415069580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d2aee97c-9776-4160-9911-2b4d6e76a260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:46:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:46:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:46:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:46:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:46:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:46:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:46:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:46:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:46:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:46:24 user nova-compute[75097]: INFO nova.compute.manager [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attaching volume 9be68849-9587-4921-8f41-ddaa0cad9d5b to /dev/vdb
Nov 14 16:46:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cde77c6-4278-458d-9465-6241f1065f46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8498b6fa-141b-4e0a-9d28-6fe9d9fc3e9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55d6bd2-1332-45ca-8b48-53ee91787de3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beb173b-0de1-437f-a27f-9c93281b4694]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:46:25 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:46:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da9060c-809e-4c44-9c73-882c6d21adb8]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:46:25 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating existing volume attachment record: 150370c9-d076-4455-adc8-5243708f7447 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:46:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzgKLvjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:46:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:46:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:46:29 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045b106-0e1f-4142-93b4-1f2693b60498]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:46:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c3d7c-ec68-46af-955d-d642df648c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b] added
Nov 14 16:46:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[59194537-c29e-4757-8f14-7a64fd4db769]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6bff1-0195-4e5b-a70d-e90c8ea3ab3b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fzgKLvjV {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fzgKLvjV" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[939f3762-6fcd-4c28-887c-d2f1896dad47]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fzgKLvjV'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[155e1f87-8c4b-498b-bdeb-a75624a26776]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faefcfd-3e8c-45f3-b631-ca79bdcc9091]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:46:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:46:29 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:46:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:46:29 user nova-compute[75097]: 
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be65c492-4f33-47a5-9409-3a73cae5f9c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260]
Nov 14 16:46:29 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260] successful.
Nov 14 16:46:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce3e84-3728-4ccd-abe3-12803bb2a552]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[648b1e5a-c8b5-4623-8114-e9d5b508b6c4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b (non-flash)
Nov 14 16:46:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b (non-flash)
Nov 14 16:46:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2060af37-c3a0-418c-9edd-dd2da2a3cc22]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzgKLvjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26334633464313563', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334633464313563', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:46:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:46:30 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:46:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:46:30 user nova-compute[75097]:   <serial>9be68849-9587-4921-8f41-ddaa0cad9d5b</serial>
Nov 14 16:46:30 user nova-compute[75097]: </disk>
Nov 14 16:46:30 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:46:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No VIF found with MAC fa:16:3e:88:4d:02, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:46:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0a13e8bd-d9e2-4174-8a37-6ce2f4f1cf56 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.119s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:46:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:46:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:46:32 user nova-compute[75097]: INFO nova.compute.manager [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Detaching volume 9be68849-9587-4921-8f41-ddaa0cad9d5b
Nov 14 16:46:32 user nova-compute[75097]: INFO nova.virt.block_device [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attempting to driver detach volume 9be68849-9587-4921-8f41-ddaa0cad9d5b from mountpoint /dev/vdb
Nov 14 16:46:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Attempting to detach device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:46:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:46:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:46:32 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:46:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:46:32 user nova-compute[75097]:   <serial>9be68849-9587-4921-8f41-ddaa0cad9d5b</serial>
Nov 14 16:46:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:46:32 user nova-compute[75097]: </disk>
Nov 14 16:46:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:46:32 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config.
Nov 14 16:46:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:46:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:46:32 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:46:32 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:46:32 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:46:32 user nova-compute[75097]:   <serial>9be68849-9587-4921-8f41-ddaa0cad9d5b</serial>
Nov 14 16:46:32 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:46:32 user nova-compute[75097]: </disk>
Nov 14 16:46:32 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:46:33 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:46:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:46:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:46:53 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 is timed out.
Nov 14 16:46:53 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config.
Nov 14 16:46:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzgKLvjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:46:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4f5bf3-17f4-4271-a0b5-d1f23eea9c80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:46:53 user nova-compute[75097]: No targets found.
Nov 14 16:46:53 user nova-compute[75097]: iSNS:
Nov 14 16:46:53 user nova-compute[75097]: No targets found.
Nov 14 16:46:53 user nova-compute[75097]: STATIC:
Nov 14 16:46:53 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b
Nov 14 16:46:53 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:46:53 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:46:53 user nova-compute[75097]: FIRMWARE:
Nov 14 16:46:53 user nova-compute[75097]: No targets found.
Nov 14 16:46:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:46:53 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:46:53 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151fe13-6cc8-4dd9-b1ad-0420408d9340]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23811cdf-0999-4956-a3c4-027f1a0d22cd]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b (non-flash)
Nov 14 16:46:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b (non-flash)
Nov 14 16:46:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf786d6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77d268-aeee-432f-9e93-bf45f0948711]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce5b09-a786-4828-bb7b-02377a49bbcf]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f9dd1-d060-4de0-8811-b5f448f9e595]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41d7ddf-ed54-432d-9716-afd6d2d40118]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606460c-7c0c-4261-8233-d8b26c84c540]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a47497-9fc4-4db0-90f7-a4d7fae7e050]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260]
Nov 14 16:46:53 user nova-compute[75097]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b, portal: 172.16.0.220,3260] successful.
Nov 14 16:46:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be68849-9587-4921-8f41-ddaa0cad9d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0f9dbb-eb0d-44ab-b093-9d10122e2455]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== disconnect_volume: return (257ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:46:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:46:54 user nova-compute[75097]: DEBUG nova.objects.instance [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:46:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-33bdc000-3e03-4b8e-ac60-243c2bacd659 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.522s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:46:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:11 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:47:12 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=24.933147430419922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d2aee97c-9776-4160-9911-2b4d6e76a260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:47:12 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:47:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'info_cache' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.network.neutron [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:47:14 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance destroyed successfully.
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'resources' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG os_vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c4d4bcd-26, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44a535b1-b641-466b-8491-7e2bd148f6ca) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:14 user nova-compute[75097]: INFO os_vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26')
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start _get_guest_xml network_info=[{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'numa_topology' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:15 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:47:15 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'vcpu_model' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'pci_devices' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:47:15 user nova-compute[75097]:   <uuid>a56a42be-8543-402d-928b-fca06198cec7</uuid>
Nov 14 16:47:15 user nova-compute[75097]:   <name>instance-00000030</name>
Nov 14 16:47:15 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:47:15 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:47:15 user nova-compute[75097]:   <metadata>
Nov 14 16:47:15 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:47:15 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:47:15 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeTestJSON-server-1449290610</nova:name>
Nov 14 16:47:15 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:47:15</nova:creationTime>
Nov 14 16:47:15 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:47:15 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:47:15 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:47:15 user nova-compute[75097]:       <nova:owner>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:user uuid="e789fb8ecb2a4113aa3ad4e60f802cea">tempest-AttachVolumeTestJSON-350193510-project-member</nova:user>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:project uuid="4686cf09fac24c94b6cbc8b7f43c474c">tempest-AttachVolumeTestJSON-350193510</nova:project>
Nov 14 16:47:15 user nova-compute[75097]:       </nova:owner>
Nov 14 16:47:15 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:47:15 user nova-compute[75097]:       <nova:ports>
Nov 14 16:47:15 user nova-compute[75097]:         <nova:port uuid="2c4d4bcd-2658-498a-b41a-0b28762c2210">
Nov 14 16:47:15 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:47:15 user nova-compute[75097]:         </nova:port>
Nov 14 16:47:15 user nova-compute[75097]:       </nova:ports>
Nov 14 16:47:15 user nova-compute[75097]:     </nova:instance>
Nov 14 16:47:15 user nova-compute[75097]:   </metadata>
Nov 14 16:47:15 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:47:15 user nova-compute[75097]:     <system>
Nov 14 16:47:15 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:47:15 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:47:15 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:47:15 user nova-compute[75097]:       <entry name="serial">a56a42be-8543-402d-928b-fca06198cec7</entry>
Nov 14 16:47:15 user nova-compute[75097]:       <entry name="uuid">a56a42be-8543-402d-928b-fca06198cec7</entry>
Nov 14 16:47:15 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:47:15 user nova-compute[75097]:     </system>
Nov 14 16:47:15 user nova-compute[75097]:   </sysinfo>
Nov 14 16:47:15 user nova-compute[75097]:   <os>
Nov 14 16:47:15 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:47:15 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:47:15 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:47:15 user nova-compute[75097]:   </os>
Nov 14 16:47:15 user nova-compute[75097]:   <features>
Nov 14 16:47:15 user nova-compute[75097]:     <acpi/>
Nov 14 16:47:15 user nova-compute[75097]:     <apic/>
Nov 14 16:47:15 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:47:15 user nova-compute[75097]:   </features>
Nov 14 16:47:15 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:47:15 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:47:15 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:47:15 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:47:15 user nova-compute[75097]:   </clock>
Nov 14 16:47:15 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:47:15 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:47:15 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:47:15 user nova-compute[75097]:   </cpu>
Nov 14 16:47:15 user nova-compute[75097]:   <devices>
Nov 14 16:47:15 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:47:15 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:47:15 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk"/>
Nov 14 16:47:15 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:47:15 user nova-compute[75097]:     </disk>
Nov 14 16:47:15 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:47:15 user nova-compute[75097]:       <mac address="fa:16:3e:ec:26:9c"/>
Nov 14 16:47:15 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:47:15 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:47:15 user nova-compute[75097]:       <target dev="tap2c4d4bcd-26"/>
Nov 14 16:47:15 user nova-compute[75097]:     </interface>
Nov 14 16:47:15 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:47:15 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/console.log" append="off"/>
Nov 14 16:47:15 user nova-compute[75097]:     </serial>
Nov 14 16:47:15 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:47:15 user nova-compute[75097]:     <video>
Nov 14 16:47:15 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:47:15 user nova-compute[75097]:     </video>
Nov 14 16:47:15 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:47:15 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:47:15 user nova-compute[75097]:     </rng>
Nov 14 16:47:15 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:47:15 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:47:15 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:47:15 user nova-compute[75097]:     </memballoon>
Nov 14 16:47:15 user nova-compute[75097]:   </devices>
Nov 14 16:47:15 user nova-compute[75097]: </domain>
Nov 14 16:47:15 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'trusted_certs' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Cannot resize image /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'migration_context' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.objects.base [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Object Instance<a56a42be-8543-402d-928b-fca06198cec7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75097) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG os_vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b83223a-c531-5c90-a94a-8941a499f866', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c4d4bcd-26, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c4d4bcd-26, col_values=(('qos', UUID('cdd1e011-0ac4-4827-8a6f-08e5fd294cc4')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c4d4bcd-26, col_values=(('external_ids', {'iface-id': '2c4d4bcd-2658-498a-b41a-0b28762c2210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:26:9c', 'vm-uuid': 'a56a42be-8543-402d-928b-fca06198cec7'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:15 user nova-compute[75097]: INFO os_vif [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26')
Nov 14 16:47:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:47:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:47:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:47:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:47:16 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:47:16 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [{"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a56a42be-8543-402d-928b-fca06198cec7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-900951bd-8d12-4975-af16-11e7f58e4e1a req-52e1d076-e2cf-438c-bee8-d0409b876187 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-900951bd-8d12-4975-af16-11e7f58e4e1a req-52e1d076-e2cf-438c-bee8-d0409b876187 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-900951bd-8d12-4975-af16-11e7f58e4e1a req-52e1d076-e2cf-438c-bee8-d0409b876187 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-900951bd-8d12-4975-af16-11e7f58e4e1a req-52e1d076-e2cf-438c-bee8-d0409b876187 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG nova.compute.manager [req-900951bd-8d12-4975-af16-11e7f58e4e1a req-52e1d076-e2cf-438c-bee8-d0409b876187 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:47:17 user nova-compute[75097]: WARNING nova.compute.manager [req-900951bd-8d12-4975-af16-11e7f58e4e1a req-52e1d076-e2cf-438c-bee8-d0409b876187 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state stopped and task_state powering-on.
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:18 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:47:19 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance rebooted successfully.
Nov 14 16:47:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-d48e0fd8-3fd9-465a-95c7-094506aca559 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-63cd2cc7-118c-46ac-9356-b1a5172c6f1c req-9a98f8ab-b32f-48e5-a338-5e6e3d86a563 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-63cd2cc7-118c-46ac-9356-b1a5172c6f1c req-9a98f8ab-b32f-48e5-a338-5e6e3d86a563 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-63cd2cc7-118c-46ac-9356-b1a5172c6f1c req-9a98f8ab-b32f-48e5-a338-5e6e3d86a563 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-63cd2cc7-118c-46ac-9356-b1a5172c6f1c req-9a98f8ab-b32f-48e5-a338-5e6e3d86a563 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:47:19 user nova-compute[75097]: DEBUG nova.compute.manager [req-63cd2cc7-118c-46ac-9356-b1a5172c6f1c req-9a98f8ab-b32f-48e5-a338-5e6e3d86a563 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:47:19 user nova-compute[75097]: WARNING nova.compute.manager [req-63cd2cc7-118c-46ac-9356-b1a5172c6f1c req-9a98f8ab-b32f-48e5-a338-5e6e3d86a563 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state active and task_state None.
Nov 14 16:47:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:25 user nova-compute[75097]: INFO nova.compute.manager [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attaching volume 196699c6-6346-4893-9406-608f95ebd582 to /dev/vdb
Nov 14 16:47:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c82ca7-a563-4b20-96fe-4ef9d8e014df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[126decb1-7a63-4336-99a7-8892c6c4eeea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce8b8af-b769-4838-9313-e80bae7d8d92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be5b56-ec91-45a1-8e9a-d1623a893e7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:47:25 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:47:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26af62-856a-4ae6-a5e2-a9fd4348c47f]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG os_brick.utils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating existing volume attachment record: f214d634-c749-48a1-8cd6-71bc8f009dba {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:47:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBWPbGwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:47:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:47:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:47:30 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f107b86-3cee-42c0-95b8-ebc6bbbe33cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:47:30 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49e376c-ae9f-4068-9d10-ad3c17f86fab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582] added
Nov 14 16:47:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[554f821b-71dc-4c31-9661-275a2cf76a12]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2379dab1-1691-43cd-8913-6aaf1267b544]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBWPbGwu {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBWPbGwu" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6e6f8-93f7-466c-8531-0fb5c2ba1106]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBWPbGwu'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[633cc93a-fd92-4d6c-895f-997709cb16eb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a26a7f-78a7-4834-b85a-7c076937364b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:47:30 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:47:30 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:47:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:47:30 user nova-compute[75097]: 
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f56b94-17e6-4938-a981-7d98a66ec45b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260]
Nov 14 16:47:30 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260] successful.
Nov 14 16:47:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[597420b1-0cd8-4d3f-8e68-69f368160acc]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfcc3de-32dd-41d9-aaae-898df16a6ae4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 (non-flash)
Nov 14 16:47:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 (non-flash)
Nov 14 16:47:30 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cdc404-f6f0-4733-bd22-33efc4871ad4]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:47:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBWPbGwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26535363035366236', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535363035366236', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:47:31 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:47:31 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:47:31 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:47:31 user nova-compute[75097]:   <serial>196699c6-6346-4893-9406-608f95ebd582</serial>
Nov 14 16:47:31 user nova-compute[75097]: </disk>
Nov 14 16:47:31 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:47:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:47:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:47:32 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] No VIF found with MAC fa:16:3e:88:4d:02, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:47:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ed6381ba-1e49-490a-9c57-4aa121edd8e4 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.086s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:47:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:47:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:47:34 user nova-compute[75097]: INFO nova.compute.manager [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Detaching volume 196699c6-6346-4893-9406-608f95ebd582
Nov 14 16:47:34 user nova-compute[75097]: INFO nova.virt.block_device [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Attempting to driver detach volume 196699c6-6346-4893-9406-608f95ebd582 from mountpoint /dev/vdb
Nov 14 16:47:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Attempting to detach device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:47:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:47:34 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:47:34 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:47:34 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:47:34 user nova-compute[75097]:   <serial>196699c6-6346-4893-9406-608f95ebd582</serial>
Nov 14 16:47:34 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:47:34 user nova-compute[75097]: </disk>
Nov 14 16:47:34 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:47:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the persistent domain config.
Nov 14 16:47:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:47:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:47:34 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:47:34 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:47:34 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:47:34 user nova-compute[75097]:   <serial>196699c6-6346-4893-9406-608f95ebd582</serial>
Nov 14 16:47:34 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:47:34 user nova-compute[75097]: </disk>
Nov 14 16:47:34 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:47:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:47:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:47:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:47:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:47:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:49 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:47:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:54 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2aee97c-9776-4160-9911-2b4d6e76a260 is timed out.
Nov 14 16:47:54 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully detached device vdb from instance d2aee97c-9776-4160-9911-2b4d6e76a260 from the live domain config.
Nov 14 16:47:54 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:47:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBWPbGwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:47:54 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:47:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:47:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:47:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c164d0-33a6-4bac-9655-710185a38a55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:47:55 user nova-compute[75097]: No targets found.
Nov 14 16:47:55 user nova-compute[75097]: iSNS:
Nov 14 16:47:55 user nova-compute[75097]: No targets found.
Nov 14 16:47:55 user nova-compute[75097]: STATIC:
Nov 14 16:47:55 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582
Nov 14 16:47:55 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:47:55 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:47:55 user nova-compute[75097]: FIRMWARE:
Nov 14 16:47:55 user nova-compute[75097]: No targets found.
Nov 14 16:47:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:47:55 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:47:55 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ddc7c0-e4b3-4ca7-a7a0-86b489358b49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d1c4a-e065-4341-80a7-d36a80d600e1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 (non-flash)
Nov 14 16:47:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 (non-flash)
Nov 14 16:47:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf987cde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d620c5-768a-4887-ba50-f1b2426766c1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b05db6-abc0-4b7b-b469-b32f60518d0c]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42afdeb-6a55-4717-b5f9-a221d1ad7837]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b7a7f-da33-4955-af46-1fb14873dc1a]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab02cfa-c4a1-46a2-a2f8-7a4e3bee1a93]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97aed3-d78b-46d7-8043-78cb1ef2bd83]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260]
Nov 14 16:47:55 user nova-compute[75097]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582, portal: 172.16.0.220,3260] successful.
Nov 14 16:47:55 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196699c6-6346-4893-9406-608f95ebd582 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4de91b7-54cd-4e46-a6f0-0d9568f3e36d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] <== disconnect_volume: return (268ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:47:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'flavor' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:47:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-994f721c-c3c9-4f15-bf43-5091a5987b14 tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.570s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:48:12 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:48:13 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:48:13 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=24.923545837402344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a56a42be-8543-402d-928b-fca06198cec7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance d2aee97c-9776-4160-9911-2b4d6e76a260 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:48:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:16 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:48:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:48:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:48:16 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:48:17 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [{"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:48:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-d2aee97c-9776-4160-9911-2b4d6e76a260" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:48:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:48:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:48:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:37 user nova-compute[75097]: INFO nova.compute.manager [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Terminating instance
Nov 14 16:48:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-b9667613-17e2-4268-a7db-2d06292990ce req-ecf2d923-7e1a-4239-a270-c11d4ef70515 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-unplugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b9667613-17e2-4268-a7db-2d06292990ce req-ecf2d923-7e1a-4239-a270-c11d4ef70515 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b9667613-17e2-4268-a7db-2d06292990ce req-ecf2d923-7e1a-4239-a270-c11d4ef70515 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b9667613-17e2-4268-a7db-2d06292990ce req-ecf2d923-7e1a-4239-a270-c11d4ef70515 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-b9667613-17e2-4268-a7db-2d06292990ce req-ecf2d923-7e1a-4239-a270-c11d4ef70515 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-unplugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG nova.compute.manager [req-b9667613-17e2-4268-a7db-2d06292990ce req-ecf2d923-7e1a-4239-a270-c11d4ef70515 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-unplugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:48:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Instance destroyed successfully.
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lazy-loading 'resources' on Instance uuid d2aee97c-9776-4160-9911-2b4d6e76a260 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1013679169',display_name='tempest-SnapshotDataIntegrityTests-server-1013679169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1013679169',id=49,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+weR5PmjyOFEacMQfZUrvkko2mRo+CYYvbzTWAPNOBiDybKDdW6GVPvFUFVGYMF83cLWsnPvFyGjgFosLpRxM/MG44DcxSFqvgYq6xjw0y4Pduho+67BaJRXFrshrP6g==',key_name='tempest-keypair-1447085410',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b5216e7a2fb437885d659f01c9d220c',ramdisk_id='',reservation_id='r-3wlxvazh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-912677661',owner_user_name='tempest-SnapshotDataIntegrityTests-912677661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:42:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d61b9fe7364340858dd2ac7b3d3620',uuid=d2aee97c-9776-4160-9911-2b4d6e76a260,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Converting VIF {"id": "9054a525-cb75-4ece-9c46-641a6482bf67", "address": "fa:16:3e:88:4d:02", "network": {"id": "199e23eb-bd4b-479c-b7d6-aa824b2a66bd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1576406747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b5216e7a2fb437885d659f01c9d220c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9054a525-cb", "ovs_interfaceid": "9054a525-cb75-4ece-9c46-641a6482bf67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG os_vif [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9054a525-cb, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3e9367d-2e2c-4d6e-9179-23bd02dcb168) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:38 user nova-compute[75097]: INFO os_vif [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:4d:02,bridge_name='br-int',has_traffic_filtering=True,id=9054a525-cb75-4ece-9c46-641a6482bf67,network=Network(199e23eb-bd4b-479c-b7d6-aa824b2a66bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9054a525-cb')
Nov 14 16:48:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Deleting instance files /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260_del
Nov 14 16:48:38 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Deletion of /opt/stack/data/nova/instances/d2aee97c-9776-4160-9911-2b4d6e76a260_del complete
Nov 14 16:48:38 user nova-compute[75097]: INFO nova.compute.manager [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 16:48:38 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:48:38 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Took 0.76 seconds to deallocate network for instance.
Nov 14 16:48:38 user nova-compute[75097]: DEBUG nova.compute.manager [req-ff0653dd-9f06-4327-ac5a-95840b65c8a3 req-6399c701-cc37-46ce-abfe-9b349a8d89a4 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-deleted-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Deleted allocations for instance d2aee97c-9776-4160-9911-2b4d6e76a260
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1ed404e8-bd99-4107-9934-a169375ab06d tempest-SnapshotDataIntegrityTests-912677661 tempest-SnapshotDataIntegrityTests-912677661-project-member] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:48:39 user nova-compute[75097]: WARNING nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state deleted and task_state None.
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:48:39 user nova-compute[75097]: WARNING nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state deleted and task_state None.
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:48:39 user nova-compute[75097]: WARNING nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state deleted and task_state None.
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-unplugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-unplugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:48:39 user nova-compute[75097]: WARNING nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-unplugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state deleted and task_state None.
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Acquiring lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] Lock "d2aee97c-9776-4160-9911-2b4d6e76a260-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:48:39 user nova-compute[75097]: DEBUG nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] No waiting events found dispatching network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:48:39 user nova-compute[75097]: WARNING nova.compute.manager [req-cd4ec7de-92d7-476f-b4b1-b35bbffa1d9d req-c0b2c94d-d378-4bf5-a378-9e42527eee95 service nova] [instance: d2aee97c-9776-4160-9911-2b4d6e76a260] Received unexpected event network-vif-plugged-9054a525-cb75-4ece-9c46-641a6482bf67 for instance with vm_state deleted and task_state None.
Nov 14 16:48:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:48:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:48:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:48:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:48:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:49:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:49:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:49:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:05 user nova-compute[75097]: INFO nova.compute.manager [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Terminating instance
Nov 14 16:49:05 user nova-compute[75097]: DEBUG nova.compute.manager [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-fbfd03b9-0c3c-480f-ad04-f4ccb81577f9 req-2c9ce8cc-e228-4099-9196-1dc81f000c80 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fbfd03b9-0c3c-480f-ad04-f4ccb81577f9 req-2c9ce8cc-e228-4099-9196-1dc81f000c80 service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fbfd03b9-0c3c-480f-ad04-f4ccb81577f9 req-2c9ce8cc-e228-4099-9196-1dc81f000c80 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fbfd03b9-0c3c-480f-ad04-f4ccb81577f9 req-2c9ce8cc-e228-4099-9196-1dc81f000c80 service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-fbfd03b9-0c3c-480f-ad04-f4ccb81577f9 req-2c9ce8cc-e228-4099-9196-1dc81f000c80 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:49:05 user nova-compute[75097]: DEBUG nova.compute.manager [req-fbfd03b9-0c3c-480f-ad04-f4ccb81577f9 req-2c9ce8cc-e228-4099-9196-1dc81f000c80 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-unplugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:49:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Instance destroyed successfully.
Nov 14 16:49:06 user nova-compute[75097]: DEBUG nova.objects.instance [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'resources' on Instance uuid a56a42be-8543-402d-928b-fca06198cec7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1449290610',display_name='tempest-AttachVolumeTestJSON-server-1449290610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1449290610',id=48,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpZmQn37Kv46kRiM7UOLBqeQuXsyON5zYIgmPNrBZ+ekmVGmfiYjD7GH3L9qOILI3XYqhkF2vGhSW2NwknAnCTjh9blNbqtA5T+GeBdRiht4yKshJklVjoswZakIb0Rg==',key_name='tempest-keypair-1476261449',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-v6bdcjjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=a56a42be-8543-402d-928b-fca06198cec7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "address": "fa:16:3e:ec:26:9c", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c4d4bcd-26", "ovs_interfaceid": "2c4d4bcd-2658-498a-b41a-0b28762c2210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG os_vif [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c4d4bcd-26, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdd1e011-0ac4-4827-8a6f-08e5fd294cc4) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:06 user nova-compute[75097]: INFO os_vif [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:26:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c4d4bcd-2658-498a-b41a-0b28762c2210,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c4d4bcd-26')
Nov 14 16:49:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Deleting instance files /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7_del
Nov 14 16:49:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Deletion of /opt/stack/data/nova/instances/a56a42be-8543-402d-928b-fca06198cec7_del complete
Nov 14 16:49:06 user nova-compute[75097]: INFO nova.compute.manager [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: a56a42be-8543-402d-928b-fca06198cec7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 16:49:06 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:49:06 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:49:07 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: a56a42be-8543-402d-928b-fca06198cec7] Took 0.74 seconds to deallocate network for instance.
Nov 14 16:49:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-a8842582-077c-4b6e-8f5a-902c831428f3 req-9ef6bdc2-1294-4452-b22e-755a7ffac0a4 service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-deleted-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:07 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Deleted allocations for instance a56a42be-8543-402d-928b-fca06198cec7
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-43378dc9-ef6c-4e4b-b151-07408e07f327 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a56a42be-8543-402d-928b-fca06198cec7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.895s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-d745deb6-4838-433a-b380-f89924f9e5de req-fff94c3b-6b50-407a-a1bb-ad82c240f36b service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d745deb6-4838-433a-b380-f89924f9e5de req-fff94c3b-6b50-407a-a1bb-ad82c240f36b service nova] Acquiring lock "a56a42be-8543-402d-928b-fca06198cec7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d745deb6-4838-433a-b380-f89924f9e5de req-fff94c3b-6b50-407a-a1bb-ad82c240f36b service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d745deb6-4838-433a-b380-f89924f9e5de req-fff94c3b-6b50-407a-a1bb-ad82c240f36b service nova] Lock "a56a42be-8543-402d-928b-fca06198cec7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:07 user nova-compute[75097]: DEBUG nova.compute.manager [req-d745deb6-4838-433a-b380-f89924f9e5de req-fff94c3b-6b50-407a-a1bb-ad82c240f36b service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] No waiting events found dispatching network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:49:07 user nova-compute[75097]: WARNING nova.compute.manager [req-d745deb6-4838-433a-b380-f89924f9e5de req-fff94c3b-6b50-407a-a1bb-ad82c240f36b service nova] [instance: a56a42be-8543-402d-928b-fca06198cec7] Received unexpected event network-vif-plugged-2c4d4bcd-2658-498a-b41a-0b28762c2210 for instance with vm_state deleted and task_state None.
Nov 14 16:49:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:49:14 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:49:14 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=24.978580474853516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:49:14 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:17 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:49:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:49:17 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:49:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:49:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:49:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:49:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:49:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:49:59 user nova-compute[75097]: INFO nova.compute.claims [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Claim successful on node user
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:49:59 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.policy [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e789fb8ecb2a4113aa3ad4e60f802cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4686cf09fac24c94b6cbc8b7f43c474c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:49:59 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Creating image(s)
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "/opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "/opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "/opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:49:59 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk 1073741824" returned: 0 in 0.052s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Successfully created port: 9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.219s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Cannot resize image /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Ensure instance console log exists: /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Successfully updated port: 9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquired lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.network.neutron [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-changed-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG nova.compute.manager [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Refreshing instance network info cache due to event network-changed-9c7ce496-aa11-43ff-8f40-c29b57791073. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:50:00 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] Acquiring lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.neutron [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Releasing lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Instance network_info: |[{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] Acquired lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Refreshing network info cache for port 9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Start _get_guest_xml network_info=[{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:50:01 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:50:01 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168196197',display_name='tempest-AttachVolumeTestJSON-server-168196197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168196197',id=50,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOZsP/h35DW1vNkOy4lNbCrgChwl7Z4LR9Pr05RQnCLrNxBM3Z70i4s30MpPpWtrhPmou84/FKJ4OEeBZ+LlbSNDxv2wG50RJ9j58NpVwoK3TsxNuCIUcuOw5ffc+LEqA==',key_name='tempest-keypair-1762822902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-93hthywm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=be660171-459a-412f-b13d-4e6711ef0ca7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.objects.instance [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'pci_devices' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:50:01 user nova-compute[75097]:   <uuid>be660171-459a-412f-b13d-4e6711ef0ca7</uuid>
Nov 14 16:50:01 user nova-compute[75097]:   <name>instance-00000032</name>
Nov 14 16:50:01 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:50:01 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:50:01 user nova-compute[75097]:   <metadata>
Nov 14 16:50:01 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:50:01 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:50:01 user nova-compute[75097]:       <nova:name>tempest-AttachVolumeTestJSON-server-168196197</nova:name>
Nov 14 16:50:01 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:50:01</nova:creationTime>
Nov 14 16:50:01 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:50:01 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:50:01 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:50:01 user nova-compute[75097]:       <nova:owner>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:user uuid="e789fb8ecb2a4113aa3ad4e60f802cea">tempest-AttachVolumeTestJSON-350193510-project-member</nova:user>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:project uuid="4686cf09fac24c94b6cbc8b7f43c474c">tempest-AttachVolumeTestJSON-350193510</nova:project>
Nov 14 16:50:01 user nova-compute[75097]:       </nova:owner>
Nov 14 16:50:01 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:50:01 user nova-compute[75097]:       <nova:ports>
Nov 14 16:50:01 user nova-compute[75097]:         <nova:port uuid="9c7ce496-aa11-43ff-8f40-c29b57791073">
Nov 14 16:50:01 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 16:50:01 user nova-compute[75097]:         </nova:port>
Nov 14 16:50:01 user nova-compute[75097]:       </nova:ports>
Nov 14 16:50:01 user nova-compute[75097]:     </nova:instance>
Nov 14 16:50:01 user nova-compute[75097]:   </metadata>
Nov 14 16:50:01 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:50:01 user nova-compute[75097]:     <system>
Nov 14 16:50:01 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:50:01 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:50:01 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:50:01 user nova-compute[75097]:       <entry name="serial">be660171-459a-412f-b13d-4e6711ef0ca7</entry>
Nov 14 16:50:01 user nova-compute[75097]:       <entry name="uuid">be660171-459a-412f-b13d-4e6711ef0ca7</entry>
Nov 14 16:50:01 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:50:01 user nova-compute[75097]:     </system>
Nov 14 16:50:01 user nova-compute[75097]:   </sysinfo>
Nov 14 16:50:01 user nova-compute[75097]:   <os>
Nov 14 16:50:01 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:50:01 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:50:01 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:50:01 user nova-compute[75097]:   </os>
Nov 14 16:50:01 user nova-compute[75097]:   <features>
Nov 14 16:50:01 user nova-compute[75097]:     <acpi/>
Nov 14 16:50:01 user nova-compute[75097]:     <apic/>
Nov 14 16:50:01 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:50:01 user nova-compute[75097]:   </features>
Nov 14 16:50:01 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:50:01 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:50:01 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:50:01 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:50:01 user nova-compute[75097]:   </clock>
Nov 14 16:50:01 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:50:01 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:50:01 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:50:01 user nova-compute[75097]:   </cpu>
Nov 14 16:50:01 user nova-compute[75097]:   <devices>
Nov 14 16:50:01 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:50:01 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:50:01 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk"/>
Nov 14 16:50:01 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:50:01 user nova-compute[75097]:     </disk>
Nov 14 16:50:01 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:50:01 user nova-compute[75097]:       <mac address="fa:16:3e:6b:3e:30"/>
Nov 14 16:50:01 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:50:01 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:50:01 user nova-compute[75097]:       <target dev="tap9c7ce496-aa"/>
Nov 14 16:50:01 user nova-compute[75097]:     </interface>
Nov 14 16:50:01 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:50:01 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/console.log" append="off"/>
Nov 14 16:50:01 user nova-compute[75097]:     </serial>
Nov 14 16:50:01 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:50:01 user nova-compute[75097]:     <video>
Nov 14 16:50:01 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:50:01 user nova-compute[75097]:     </video>
Nov 14 16:50:01 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:50:01 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:50:01 user nova-compute[75097]:     </rng>
Nov 14 16:50:01 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:50:01 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:50:01 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:50:01 user nova-compute[75097]:     </memballoon>
Nov 14 16:50:01 user nova-compute[75097]:   </devices>
Nov 14 16:50:01 user nova-compute[75097]: </domain>
Nov 14 16:50:01 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168196197',display_name='tempest-AttachVolumeTestJSON-server-168196197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168196197',id=50,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOZsP/h35DW1vNkOy4lNbCrgChwl7Z4LR9Pr05RQnCLrNxBM3Z70i4s30MpPpWtrhPmou84/FKJ4OEeBZ+LlbSNDxv2wG50RJ9j58NpVwoK3TsxNuCIUcuOw5ffc+LEqA==',key_name='tempest-keypair-1762822902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-93hthywm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=be660171-459a-412f-b13d-4e6711ef0ca7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG os_vif [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e77d1e6a-61e2-573b-8c52-3ccb2b46f5eb', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c7ce496-aa, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c7ce496-aa, col_values=(('qos', UUID('f56a8aec-330f-44e1-af39-161bd045a19f')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c7ce496-aa, col_values=(('external_ids', {'iface-id': '9c7ce496-aa11-43ff-8f40-c29b57791073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:3e:30', 'vm-uuid': 'be660171-459a-412f-b13d-4e6711ef0ca7'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:01 user nova-compute[75097]: INFO os_vif [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa')
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No VIF found with MAC fa:16:3e:6b:3e:30, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updated VIF entry in instance network info cache for port 9c7ce496-aa11-43ff-8f40-c29b57791073. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG nova.network.neutron [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:50:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-a6944499-a6e0-48e6-b619-67eab115a73e req-7ab74b55-2c26-4735-aa12-694e8472b7d6 service nova] Releasing lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:50:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] No waiting events found dispatching network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:50:03 user nova-compute[75097]: WARNING nova.compute.manager [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received unexpected event network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 for instance with vm_state building and task_state spawning.
Nov 14 16:50:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] No waiting events found dispatching network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:50:03 user nova-compute[75097]: WARNING nova.compute.manager [req-fca9c5cd-e573-4eb1-b163-4e52987799dc req-5b526a80-ce66-4ed8-b3b4-104b9ca581ef service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received unexpected event network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 for instance with vm_state building and task_state spawning.
Nov 14 16:50:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:50:04 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Instance spawned successfully.
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:50:04 user nova-compute[75097]: INFO nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 14 16:50:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:50:04 user nova-compute[75097]: INFO nova.compute.manager [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Took 5.76 seconds to build instance.
Nov 14 16:50:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-77151430-ea36-4ecc-9ded-f12a610415ca tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.859s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:50:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:50:17 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:50:17 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=24.97595977783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance be660171-459a-412f-b13d-4e6711ef0ca7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:50:17 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:19 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:50:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:26 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:50:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:50:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:51:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:18 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:19 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:51:19 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=24.947589874267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance be660171-459a-412f-b13d-4e6711ef0ca7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:51:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:51:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:51:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-changed-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG nova.compute.manager [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Refreshing instance network info cache due to event network-changed-9c7ce496-aa11-43ff-8f40-c29b57791073. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] Acquiring lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] Acquired lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Refreshing network info cache for port 9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updated VIF entry in instance network info cache for port 9c7ce496-aa11-43ff-8f40-c29b57791073. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG nova.network.neutron [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:51:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-454d190c-f016-4a7c-a51a-56f41d50916f req-1faf3821-7c62-4d00-a35a-089f73a1b29f service nova] Releasing lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:51:51 user nova-compute[75097]: INFO nova.compute.manager [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attaching volume 6ce176e5-6e04-4335-9cf3-b23dcff64a66 to /dev/vdb
Nov 14 16:51:51 user nova-compute[75097]: DEBUG os_brick.utils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6485549-e7ad-48d1-94e4-a8e3f67585a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c8617e-a6be-4612-95e2-2128ab85b00e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b987224-5150-4048-8871-e1e04505720c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[458dc1ee-5054-48e4-9f96-50237e04fd58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:51:52 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:51:52 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[799f964e-61bd-48c2-830a-6a1628731f19]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG os_brick.utils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating existing volume attachment record: f8a3abea-fd00-4c66-9621-59d2293637b6 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:51:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdgLKyxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:51:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:51:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:51:56 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f5d937-5ffd-49ad-b32d-10cab4d4bdd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:51:56 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[20903980-ded9-4a8f-8a92-a1c8e03a6fa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66] added
Nov 14 16:51:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7622f95-fc6d-4f17-a035-e4de6efc77f3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[890dbc0a-f4ce-4237-b835-3ab5e8da321b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdgLKyxU {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pdgLKyxU" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[34278101-9903-4e4f-8760-b26390ccce84]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pdgLKyxU'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[712f8930-ecae-4179-a91d-c3cc02cc0ab9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[632b2434-722e-4d93-87d1-e493104530a8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:51:56 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:51:56 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:51:56 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:51:56 user nova-compute[75097]: 
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39214eb-0c89-43bb-b280-05598aae1f3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260]
Nov 14 16:51:56 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260] successful.
Nov 14 16:51:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d605ba8b-7dcc-4927-9dc7-14c900b5fba0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2818aab7-0463-48eb-bd39-a9510b33ebb5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:51:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:51:56 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8f6bf8-255b-4bcc-9918-366f95334e3d]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:51:56 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdgLKyxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23830633563376537', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633563376537', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG nova.objects.instance [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:51:57 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:51:57 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:51:57 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:51:57 user nova-compute[75097]:   <serial>6ce176e5-6e04-4335-9cf3-b23dcff64a66</serial>
Nov 14 16:51:57 user nova-compute[75097]: </disk>
Nov 14 16:51:57 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No VIF found with MAC fa:16:3e:6b:3e:30, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:51:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-53e2c170-7ca3-401b-bec2-c466b95583c3 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.161s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:51:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:51:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:51:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:51:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:51:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:51:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:51:59 user nova-compute[75097]: INFO nova.compute.manager [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attaching volume 69a2b31e-70d4-43b4-90c2-328dbb9a79ed to /dev/vdc
Nov 14 16:52:00 user nova-compute[75097]: DEBUG os_brick.utils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a1b74-c103-417f-bac5-1fd2ee5f0bc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c1d13e-8a5d-4916-b968-f40beeeb4265]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e92bf3-cce4-4ed2-97e5-eb3f07bdb9ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b921cfb-5fc7-4c24-bc41-29d488ce51ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:52:00 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:52:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c24b42-2542-4173-8d4b-3cc57f1b431d]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG os_brick.utils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:52:00 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating existing volume attachment record: cde2bda9-3669-4629-941d-3962beee68ee {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:52:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tArdzOGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:52:04 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:52:04 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.042s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:52:04 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[84886532-b98f-47ee-92af-36d6afe5e033]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:52:04 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[40203c60-8e88-43ef-9550-ae807c2d7c31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed] added
Nov 14 16:52:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c6f8eb-878e-4036-bced-07a597f2f7cb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbad805-725b-4440-879e-7cdca586eb74]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tArdzOGo {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tArdzOGo" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5571e0fb-5c44-42f9-9f45-7a13ccca2607]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tArdzOGo'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2dadd-6cc3-4465-abb4-ea7433c078a1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9906570-6a47-4244-91f9-89a9d70f09b7]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:52:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:52:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[83118c16-9dde-4b52-bd9e-19cab00a8127]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260]
Nov 14 16:52:04 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260] successful.
Nov 14 16:52:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07afc0-9aa3-4add-a807-50b3a19bb421]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a9b60a-f872-4066-a1d4-9c5fe03a6f32]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:52:04 user nova-compute[75097]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)
Nov 14 16:52:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:52:04 user nova-compute[75097]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)
Nov 14 16:52:04 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405f290-f7e0-4849-9fe7-d699a1b5e52c]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:04 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tArdzOGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23335303134336138', 'path': '/dev/sdc'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303134336138', 'path': '/dev/sdc'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:52:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:52:05 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:52:05 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:52:05 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:52:05 user nova-compute[75097]:   <serial>69a2b31e-70d4-43b4-90c2-328dbb9a79ed</serial>
Nov 14 16:52:05 user nova-compute[75097]: </disk>
Nov 14 16:52:05 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] No VIF found with MAC fa:16:3e:6b:3e:30, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1b349290-3ce2-47a0-8eba-b207b9c2f017 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.242s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:06 user nova-compute[75097]: INFO nova.compute.manager [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Detaching volume 6ce176e5-6e04-4335-9cf3-b23dcff64a66
Nov 14 16:52:06 user nova-compute[75097]: INFO nova.virt.block_device [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attempting to driver detach volume 6ce176e5-6e04-4335-9cf3-b23dcff64a66 from mountpoint /dev/vdb
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Attempting to detach device vdb from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:52:06 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:52:06 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:52:06 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:52:06 user nova-compute[75097]:   <serial>6ce176e5-6e04-4335-9cf3-b23dcff64a66</serial>
Nov 14 16:52:06 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:52:06 user nova-compute[75097]: </disk>
Nov 14 16:52:06 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:52:06 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully detached device vdb from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the persistent domain config.
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:52:06 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:52:06 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:52:06 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:52:06 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:52:06 user nova-compute[75097]:   <serial>6ce176e5-6e04-4335-9cf3-b23dcff64a66</serial>
Nov 14 16:52:06 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:52:06 user nova-compute[75097]: </disk>
Nov 14 16:52:06 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:52:07 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:52:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:19 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75097) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 16:52:20 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:52:20 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.93844985961914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance be660171-459a-412f-b13d-4e6711ef0ca7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:52:20 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:52:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [{"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-be660171-459a-412f-b13d-4e6711ef0ca7" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:52:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:52:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:26 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:26 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:27 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be660171-459a-412f-b13d-4e6711ef0ca7 is timed out.
Nov 14 16:52:27 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully detached device vdb from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the live domain config.
Nov 14 16:52:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pdgLKyxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:52:27 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[066dbea2-52ad-482c-8fef-98616065902d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:52:27 user nova-compute[75097]: No targets found.
Nov 14 16:52:27 user nova-compute[75097]: iSNS:
Nov 14 16:52:27 user nova-compute[75097]: No targets found.
Nov 14 16:52:27 user nova-compute[75097]: STATIC:
Nov 14 16:52:27 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed
Nov 14 16:52:27 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:52:27 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:52:27 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66
Nov 14 16:52:27 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:52:27 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:52:27 user nova-compute[75097]: FIRMWARE:
Nov 14 16:52:27 user nova-compute[75097]: No targets found.
Nov 14 16:52:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:52:27 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:52:27 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf587a98-b3ac-44ff-8e61-eb1ccd80679c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b92649-89da-4383-8c43-b45e76449c3b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:52:27 user nova-compute[75097]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)
Nov 14 16:52:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 (non-flash)
Nov 14 16:52:27 user nova-compute[75097]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)
Nov 14 16:52:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc6f40-68be-4896-aa44-75f98265e18d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b51eb-0752-4bfb-ab2a-6df1cc71c7c1]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a46820-3ef6-4dc8-95e9-b124bb4e1ced]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[522e986d-199d-48cc-acb4-9aa8d2ddc8c2]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6a694-7240-4d31-b450-e67ee3af202d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c37b4b4-fc46-48f5-b1b2-21a74c6e5768]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260]
Nov 14 16:52:27 user nova-compute[75097]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66, portal: 172.16.0.220,3260] successful.
Nov 14 16:52:27 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ce176e5-6e04-4335-9cf3-b23dcff64a66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f83b18-bcaa-4f0d-9aea-4b720769f8d1]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== disconnect_volume: return (309ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:52:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:52:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:52:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-0b11333f-c58d-49c1-8fc8-588176850b8a tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:52:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:29 user nova-compute[75097]: INFO nova.compute.manager [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Detaching volume 69a2b31e-70d4-43b4-90c2-328dbb9a79ed
Nov 14 16:52:29 user nova-compute[75097]: INFO nova.virt.block_device [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Attempting to driver detach volume 69a2b31e-70d4-43b4-90c2-328dbb9a79ed from mountpoint /dev/vdc
Nov 14 16:52:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Attempting to detach device vdc from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:52:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:52:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:52:29 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:52:29 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:52:29 user nova-compute[75097]:   <serial>69a2b31e-70d4-43b4-90c2-328dbb9a79ed</serial>
Nov 14 16:52:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 16:52:29 user nova-compute[75097]: </disk>
Nov 14 16:52:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:52:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully detached device vdc from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the persistent domain config.
Nov 14 16:52:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:52:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:52:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:52:29 user nova-compute[75097]:   <source dev="/dev/sdc"/>
Nov 14 16:52:29 user nova-compute[75097]:   <target dev="vdc" bus="virtio"/>
Nov 14 16:52:29 user nova-compute[75097]:   <serial>69a2b31e-70d4-43b4-90c2-328dbb9a79ed</serial>
Nov 14 16:52:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 16:52:29 user nova-compute[75097]: </disk>
Nov 14 16:52:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:52:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:52:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:36 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:41 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:46 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:49 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance be660171-459a-412f-b13d-4e6711ef0ca7 is timed out.
Nov 14 16:52:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully detached device vdc from instance be660171-459a-412f-b13d-4e6711ef0ca7 from the live domain config.
Nov 14 16:52:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tArdzOGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:52:50 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb4fe9-c3b8-4597-b71a-62fc6480aebe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:52:50 user nova-compute[75097]: No targets found.
Nov 14 16:52:50 user nova-compute[75097]: iSNS:
Nov 14 16:52:50 user nova-compute[75097]: No targets found.
Nov 14 16:52:50 user nova-compute[75097]: STATIC:
Nov 14 16:52:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed
Nov 14 16:52:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:52:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:52:50 user nova-compute[75097]: FIRMWARE:
Nov 14 16:52:50 user nova-compute[75097]: No targets found.
Nov 14 16:52:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:52:50 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:52:50 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd89377-bacf-41db-a39c-a3413ed5b968]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c585f516-651f-490f-9e4d-0d98bb9755bc]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)
Nov 14 16:52:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed (non-flash)
Nov 14 16:52:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf98722dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed'): ({'sdc'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Removing single pathed devices sdc {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27a7a4-2c0e-4279-8150-17445342e19b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[df50a406-370a-439b-8a03-6bdb560c739d]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Flushing IO for device /dev/sdc {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd7a04e-67ad-4827-8a52-13d2ba21e01a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8e6879-27f5-48de-8b14-c810c4a378fa]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] SCSI volumes sdc have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d273e-b252-4c07-89dc-f64ae0ae3d00]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b08a13-b5bf-49be-9509-bd4ec2fdec7e]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260]
Nov 14 16:52:50 user nova-compute[75097]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed, portal: 172.16.0.220,3260] successful.
Nov 14 16:52:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a2b31e-70d4-43b4-90c2-328dbb9a79ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34fe3a9-5cbf-49e8-8ffb-abdc6f2e6aea]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] <== disconnect_volume: return (296ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:52:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:52:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'flavor' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:52:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cc15a918-4eef-47fd-90d7-f2f6f75be064 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.777s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:51 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:52 user nova-compute[75097]: INFO nova.compute.manager [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Terminating instance
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.compute.manager [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-490cd775-6faa-4680-a5d0-f31efc533c45 req-9db5fd9c-d505-4c4b-99dc-6d634fcb2c4c service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-vif-unplugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-490cd775-6faa-4680-a5d0-f31efc533c45 req-9db5fd9c-d505-4c4b-99dc-6d634fcb2c4c service nova] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-490cd775-6faa-4680-a5d0-f31efc533c45 req-9db5fd9c-d505-4c4b-99dc-6d634fcb2c4c service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-490cd775-6faa-4680-a5d0-f31efc533c45 req-9db5fd9c-d505-4c4b-99dc-6d634fcb2c4c service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-490cd775-6faa-4680-a5d0-f31efc533c45 req-9db5fd9c-d505-4c4b-99dc-6d634fcb2c4c service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] No waiting events found dispatching network-vif-unplugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.compute.manager [req-490cd775-6faa-4680-a5d0-f31efc533c45 req-9db5fd9c-d505-4c4b-99dc-6d634fcb2c4c service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-vif-unplugged-9c7ce496-aa11-43ff-8f40-c29b57791073 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Instance destroyed successfully.
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.objects.instance [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lazy-loading 'resources' on Instance uuid be660171-459a-412f-b13d-4e6711ef0ca7 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-168196197',display_name='tempest-AttachVolumeTestJSON-server-168196197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-168196197',id=50,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOZsP/h35DW1vNkOy4lNbCrgChwl7Z4LR9Pr05RQnCLrNxBM3Z70i4s30MpPpWtrhPmou84/FKJ4OEeBZ+LlbSNDxv2wG50RJ9j58NpVwoK3TsxNuCIUcuOw5ffc+LEqA==',key_name='tempest-keypair-1762822902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4686cf09fac24c94b6cbc8b7f43c474c',ramdisk_id='',reservation_id='r-93hthywm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-350193510',owner_user_name='tempest-AttachVolumeTestJSON-350193510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e789fb8ecb2a4113aa3ad4e60f802cea',uuid=be660171-459a-412f-b13d-4e6711ef0ca7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converting VIF {"id": "9c7ce496-aa11-43ff-8f40-c29b57791073", "address": "fa:16:3e:6b:3e:30", "network": {"id": "de90af34-d9ff-4fec-9486-dc88f579c14a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1346891970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4686cf09fac24c94b6cbc8b7f43c474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce496-aa", "ovs_interfaceid": "9c7ce496-aa11-43ff-8f40-c29b57791073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG os_vif [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c7ce496-aa, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f56a8aec-330f-44e1-af39-161bd045a19f) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:52:52 user nova-compute[75097]: INFO os_vif [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:3e:30,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce496-aa11-43ff-8f40-c29b57791073,network=Network(de90af34-d9ff-4fec-9486-dc88f579c14a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce496-aa')
Nov 14 16:52:52 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Deleting instance files /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7_del
Nov 14 16:52:52 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Deletion of /opt/stack/data/nova/instances/be660171-459a-412f-b13d-4e6711ef0ca7_del complete
Nov 14 16:52:53 user nova-compute[75097]: INFO nova.compute.manager [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 16:52:53 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:52:53 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:52:53 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:52:53 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:52:53 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Took 0.80 seconds to deallocate network for instance.
Nov 14 16:52:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:53 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:53 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:54 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Deleted allocations for instance be660171-459a-412f-b13d-4e6711ef0ca7
Nov 14 16:52:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-617064b9-b63f-49ea-9660-cd04ee2baa75 tempest-AttachVolumeTestJSON-350193510 tempest-AttachVolumeTestJSON-350193510-project-member] Lock "be660171-459a-412f-b13d-4e6711ef0ca7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] Acquiring lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] Lock "be660171-459a-412f-b13d-4e6711ef0ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:52:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] No waiting events found dispatching network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:52:54 user nova-compute[75097]: WARNING nova.compute.manager [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received unexpected event network-vif-plugged-9c7ce496-aa11-43ff-8f40-c29b57791073 for instance with vm_state deleted and task_state None.
Nov 14 16:52:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-f1001dd3-e7b9-4a1b-b7e7-1ed6cfa85b41 req-afbba5c4-cebd-4faf-9c6f-0a8113f8cd9e service nova] [instance: be660171-459a-412f-b13d-4e6711ef0ca7] Received event network-vif-deleted-9c7ce496-aa11-43ff-8f40-c29b57791073 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:52:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:53:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:53:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:53:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:53:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:53:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:53:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:53:19 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:53:19 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=24.96536636352539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:53:19 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:53:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:53:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:53:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:53:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:53:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:26 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:53:52 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:53:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:53:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:03 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:54:08 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:13 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:18 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:54:21 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:54:21 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=24.962909698486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:54:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:54:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:54:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:54:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:54:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:28 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:54:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:38 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:43 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:48 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:53 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:54:57 user nova-compute[75097]: INFO nova.compute.claims [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Claim successful on node user
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.network.neutron [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:54:57 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:54:57 user nova-compute[75097]: DEBUG nova.policy [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0f638a17d024df8b22c9d09dbac62e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4ead12218e43c79c7965fbe4dc9f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:54:58 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Creating image(s)
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "/opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "/opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "/opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.179s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk 1073741824" returned: 0 in 0.057s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.network.neutron [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Successfully created port: d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Cannot resize image /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Ensure instance console log exists: /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:54:58 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Successfully updated port: d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquired lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-changed-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.compute.manager [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Refreshing instance network info cache due to event network-changed-d2f5996e-4a34-48ca-8cff-425fa0a550de. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] Acquiring lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating instance_info_cache with network_info: [{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Releasing lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Instance network_info: |[{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] Acquired lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Refreshing network info cache for port d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Start _get_guest_xml network_info=[{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:54:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:54:59 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-204553264',display_name='tempest-VolumesSnapshotTestJSON-instance-204553264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-204553264',id=51,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYbJePzwM5Ko7unuGdbv8F3wuv66nYrgLNwzMEoyVXn24ns3wYOHvwlyYNLmj8h0/Qk2/aeG2ez1aI6prrB/K/NSiZ+lInWxYcisrmy8TGtsFKIDTnMae3/IHg6o8jEA==',key_name='tempest-keypair-625769455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4ead12218e43c79c7965fbe4dc9f54',ramdisk_id='',reservation_id='r-vqxbyum4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-126086455',owner_user_name='tempest-VolumesSnapshotTestJSON-126086455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0f638a17d024df8b22c9d09dbac62e5',uuid=a555800c-7774-4cb3-9fa9-fa96719e93ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converting VIF {"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.objects.instance [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'pci_devices' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:54:59 user nova-compute[75097]:   <uuid>a555800c-7774-4cb3-9fa9-fa96719e93ac</uuid>
Nov 14 16:54:59 user nova-compute[75097]:   <name>instance-00000033</name>
Nov 14 16:54:59 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:54:59 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:54:59 user nova-compute[75097]:   <metadata>
Nov 14 16:54:59 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:54:59 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:54:59 user nova-compute[75097]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-204553264</nova:name>
Nov 14 16:54:59 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:54:59</nova:creationTime>
Nov 14 16:54:59 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:54:59 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:54:59 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:54:59 user nova-compute[75097]:       <nova:owner>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:user uuid="c0f638a17d024df8b22c9d09dbac62e5">tempest-VolumesSnapshotTestJSON-126086455-project-member</nova:user>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:project uuid="4e4ead12218e43c79c7965fbe4dc9f54">tempest-VolumesSnapshotTestJSON-126086455</nova:project>
Nov 14 16:54:59 user nova-compute[75097]:       </nova:owner>
Nov 14 16:54:59 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:54:59 user nova-compute[75097]:       <nova:ports>
Nov 14 16:54:59 user nova-compute[75097]:         <nova:port uuid="d2f5996e-4a34-48ca-8cff-425fa0a550de">
Nov 14 16:54:59 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 16:54:59 user nova-compute[75097]:         </nova:port>
Nov 14 16:54:59 user nova-compute[75097]:       </nova:ports>
Nov 14 16:54:59 user nova-compute[75097]:     </nova:instance>
Nov 14 16:54:59 user nova-compute[75097]:   </metadata>
Nov 14 16:54:59 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:54:59 user nova-compute[75097]:     <system>
Nov 14 16:54:59 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:54:59 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:54:59 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:54:59 user nova-compute[75097]:       <entry name="serial">a555800c-7774-4cb3-9fa9-fa96719e93ac</entry>
Nov 14 16:54:59 user nova-compute[75097]:       <entry name="uuid">a555800c-7774-4cb3-9fa9-fa96719e93ac</entry>
Nov 14 16:54:59 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:54:59 user nova-compute[75097]:     </system>
Nov 14 16:54:59 user nova-compute[75097]:   </sysinfo>
Nov 14 16:54:59 user nova-compute[75097]:   <os>
Nov 14 16:54:59 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:54:59 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:54:59 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:54:59 user nova-compute[75097]:   </os>
Nov 14 16:54:59 user nova-compute[75097]:   <features>
Nov 14 16:54:59 user nova-compute[75097]:     <acpi/>
Nov 14 16:54:59 user nova-compute[75097]:     <apic/>
Nov 14 16:54:59 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:54:59 user nova-compute[75097]:   </features>
Nov 14 16:54:59 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:54:59 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:54:59 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:54:59 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:54:59 user nova-compute[75097]:   </clock>
Nov 14 16:54:59 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:54:59 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:54:59 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:54:59 user nova-compute[75097]:   </cpu>
Nov 14 16:54:59 user nova-compute[75097]:   <devices>
Nov 14 16:54:59 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:54:59 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:54:59 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk"/>
Nov 14 16:54:59 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:54:59 user nova-compute[75097]:     </disk>
Nov 14 16:54:59 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:54:59 user nova-compute[75097]:       <mac address="fa:16:3e:73:95:6a"/>
Nov 14 16:54:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:54:59 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:54:59 user nova-compute[75097]:       <target dev="tapd2f5996e-4a"/>
Nov 14 16:54:59 user nova-compute[75097]:     </interface>
Nov 14 16:54:59 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:54:59 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/console.log" append="off"/>
Nov 14 16:54:59 user nova-compute[75097]:     </serial>
Nov 14 16:54:59 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:54:59 user nova-compute[75097]:     <video>
Nov 14 16:54:59 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:54:59 user nova-compute[75097]:     </video>
Nov 14 16:54:59 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:54:59 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:54:59 user nova-compute[75097]:     </rng>
Nov 14 16:54:59 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:54:59 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:54:59 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:54:59 user nova-compute[75097]:     </memballoon>
Nov 14 16:54:59 user nova-compute[75097]:   </devices>
Nov 14 16:54:59 user nova-compute[75097]: </domain>
Nov 14 16:54:59 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-204553264',display_name='tempest-VolumesSnapshotTestJSON-instance-204553264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-204553264',id=51,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYbJePzwM5Ko7unuGdbv8F3wuv66nYrgLNwzMEoyVXn24ns3wYOHvwlyYNLmj8h0/Qk2/aeG2ez1aI6prrB/K/NSiZ+lInWxYcisrmy8TGtsFKIDTnMae3/IHg6o8jEA==',key_name='tempest-keypair-625769455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4ead12218e43c79c7965fbe4dc9f54',ramdisk_id='',reservation_id='r-vqxbyum4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-126086455',owner_user_name='tempest-VolumesSnapshotTestJSON-126086455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0f638a17d024df8b22c9d09dbac62e5',uuid=a555800c-7774-4cb3-9fa9-fa96719e93ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converting VIF {"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG os_vif [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28f4195a-8405-54f8-9ed1-3ad01739da44', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2f5996e-4a, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2f5996e-4a, col_values=(('qos', UUID('cac8e326-c57d-4c0e-9495-0b187dfac25d')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2f5996e-4a, col_values=(('external_ids', {'iface-id': 'd2f5996e-4a34-48ca-8cff-425fa0a550de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:95:6a', 'vm-uuid': 'a555800c-7774-4cb3-9fa9-fa96719e93ac'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:54:59 user nova-compute[75097]: INFO os_vif [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a')
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No VIF found with MAC fa:16:3e:73:95:6a, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updated VIF entry in instance network info cache for port d2f5996e-4a34-48ca-8cff-425fa0a550de. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG nova.network.neutron [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating instance_info_cache with network_info: [{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:54:59 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-3e9c39fb-4f85-4bfc-ab56-42a6d4b3aebf req-b304b368-db40-4607-bd7a-5eb9da2fae2f service nova] Releasing lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:55:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d8f7caff-f87b-4694-9da3-fcd7150e3e73 req-8956edc9-50f8-4779-8a57-55b22d6df197 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8f7caff-f87b-4694-9da3-fcd7150e3e73 req-8956edc9-50f8-4779-8a57-55b22d6df197 service nova] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8f7caff-f87b-4694-9da3-fcd7150e3e73 req-8956edc9-50f8-4779-8a57-55b22d6df197 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-d8f7caff-f87b-4694-9da3-fcd7150e3e73 req-8956edc9-50f8-4779-8a57-55b22d6df197 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG nova.compute.manager [req-d8f7caff-f87b-4694-9da3-fcd7150e3e73 req-8956edc9-50f8-4779-8a57-55b22d6df197 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] No waiting events found dispatching network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:55:01 user nova-compute[75097]: WARNING nova.compute.manager [req-d8f7caff-f87b-4694-9da3-fcd7150e3e73 req-8956edc9-50f8-4779-8a57-55b22d6df197 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received unexpected event network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de for instance with vm_state building and task_state spawning.
Nov 14 16:55:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:01 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:02 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:55:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:55:02 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Instance spawned successfully.
Nov 14 16:55:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:55:03 user nova-compute[75097]: INFO nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:55:03 user nova-compute[75097]: INFO nova.compute.manager [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Took 5.68 seconds to build instance.
Nov 14 16:55:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-22b14996-2b8e-44fd-aaed-850fbe454706 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.780s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-60555eb5-2c7b-4e54-b7b3-0f9df812aafa req-fbf48791-a87f-4436-8278-4e12a05106d6 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-60555eb5-2c7b-4e54-b7b3-0f9df812aafa req-fbf48791-a87f-4436-8278-4e12a05106d6 service nova] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-60555eb5-2c7b-4e54-b7b3-0f9df812aafa req-fbf48791-a87f-4436-8278-4e12a05106d6 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-60555eb5-2c7b-4e54-b7b3-0f9df812aafa req-fbf48791-a87f-4436-8278-4e12a05106d6 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:55:03 user nova-compute[75097]: DEBUG nova.compute.manager [req-60555eb5-2c7b-4e54-b7b3-0f9df812aafa req-fbf48791-a87f-4436-8278-4e12a05106d6 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] No waiting events found dispatching network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:55:03 user nova-compute[75097]: WARNING nova.compute.manager [req-60555eb5-2c7b-4e54-b7b3-0f9df812aafa req-fbf48791-a87f-4436-8278-4e12a05106d6 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received unexpected event network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de for instance with vm_state active and task_state None.
Nov 14 16:55:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:22 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:55:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:55:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:55:24 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:55:24 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=24.925411224365234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a555800c-7774-4cb3-9fa9-fa96719e93ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:55:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating instance_info_cache with network_info: [{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:55:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:55:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:55:54 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:55:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:55:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:55:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:55:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:55:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:55:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:55:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:56:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:56:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:56:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:56:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:56:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:56:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:56:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:56:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:56:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:56:25 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:56:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:26 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:56:26 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.923389434814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance a555800c-7774-4cb3-9fa9-fa96719e93ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:56:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating instance_info_cache with network_info: [{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:56:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:56:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:56:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:56:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:56:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-changed-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG nova.compute.manager [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Refreshing instance network info cache due to event network-changed-d2f5996e-4a34-48ca-8cff-425fa0a550de. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] Acquiring lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] Acquired lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Refreshing network info cache for port d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG nova.objects.instance [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'flavor' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:56:48 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Ignoring supplied device name: /dev/vdb
Nov 14 16:56:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updated VIF entry in instance network info cache for port d2f5996e-4a34-48ca-8cff-425fa0a550de. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG nova.network.neutron [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating instance_info_cache with network_info: [{"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:56:48 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-b419f6ac-1b68-4eea-bba4-7edd460fda6a req-ba084197-3ccf-41ad-b266-81ba22011811 service nova] Releasing lock "refresh_cache-a555800c-7774-4cb3-9fa9-fa96719e93ac" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:56:49 user nova-compute[75097]: INFO nova.compute.manager [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Attaching volume 26f6905f-34e0-4604-9dea-082630dda13f to /dev/vdb
Nov 14 16:56:49 user nova-compute[75097]: DEBUG os_brick.utils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[df317d97-eada-4c17-82f1-14be7fdc961d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[348c4e72-efb7-4611-8171-0d0f4067c41f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9caa388-947e-469a-9da4-1bb91b874eba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2c431-eca6-4485-8301-60d9adf5831a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:56:49 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:56:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c12db-a3a2-4b1f-9654-15bbe73293a7]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG os_brick.utils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:56:49 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating existing volume attachment record: 7a9b27fc-0942-44c4-b1af-3dcf69cf8737 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:56:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCAmRByV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:56:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:56:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:56:53 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d15a1-3e23-4c88-9614-d76cb8d73601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 16:56:53 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70350d6-940f-41c5-9fe3-4928ce39333b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f] added
Nov 14 16:56:53 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd3dae4-5f8c-4843-8e49-c994770eab45]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[189ac39e-e093-4033-9465-7e059a27a801]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCAmRByV {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCAmRByV" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b91cdc1-81a7-41e7-9803-6b4cc3772aea]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCAmRByV'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30864e2-62cb-4cc2-95df-e9f896719fc7]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14a46fb-76ee-4617-8fae-4d6d656c6ac8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:56:53 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:56:53 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 16:56:53 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:56:53 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 16:56:53 user nova-compute[75097]: 
Nov 14 16:56:53 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b0adb-8299-48d7-898b-c5273af86999]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260]
Nov 14 16:56:54 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260] successful.
Nov 14 16:56:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b050fd-d096-4adf-8111-ddc0556ef710]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[19be098b-635a-469b-bfd8-3eabac2cad96]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f (non-flash)
Nov 14 16:56:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f (non-flash)
Nov 14 16:56:54 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27414380-e9bf-475a-9e94-ba9ccbcd6de1]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCAmRByV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 16:56:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '26566383939626136', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566383939626136', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'flavor' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 16:56:55 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:56:55 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:56:55 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:56:55 user nova-compute[75097]:   <serial>26f6905f-34e0-4604-9dea-082630dda13f</serial>
Nov 14 16:56:55 user nova-compute[75097]: </disk>
Nov 14 16:56:55 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No VIF found with MAC fa:16:3e:73:95:6a, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:56:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-15c0a07d-e915-4c6e-87eb-4578f433cbee tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.149s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:56:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:56:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:03 user nova-compute[75097]: INFO nova.compute.manager [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Detaching volume 26f6905f-34e0-4604-9dea-082630dda13f
Nov 14 16:57:03 user nova-compute[75097]: INFO nova.virt.block_device [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Attempting to driver detach volume 26f6905f-34e0-4604-9dea-082630dda13f from mountpoint /dev/vdb
Nov 14 16:57:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Attempting to detach device vdb from instance a555800c-7774-4cb3-9fa9-fa96719e93ac from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 16:57:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:57:03 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:57:03 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:57:03 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:57:03 user nova-compute[75097]:   <serial>26f6905f-34e0-4604-9dea-082630dda13f</serial>
Nov 14 16:57:03 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:57:03 user nova-compute[75097]: </disk>
Nov 14 16:57:03 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:57:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully detached device vdb from instance a555800c-7774-4cb3-9fa9-fa96719e93ac from the persistent domain config.
Nov 14 16:57:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a555800c-7774-4cb3-9fa9-fa96719e93ac from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 16:57:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 16:57:03 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 16:57:03 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 16:57:03 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 16:57:03 user nova-compute[75097]:   <serial>26f6905f-34e0-4604-9dea-082630dda13f</serial>
Nov 14 16:57:03 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 16:57:03 user nova-compute[75097]: </disk>
Nov 14 16:57:03 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 16:57:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 16:57:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:57:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:57:23 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a555800c-7774-4cb3-9fa9-fa96719e93ac is timed out.
Nov 14 16:57:23 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully detached device vdb from instance a555800c-7774-4cb3-9fa9-fa96719e93ac from the live domain config.
Nov 14 16:57:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCAmRByV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:57:23 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45ce7f-2292-482e-bc35-2a0b883dc4e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 16:57:23 user nova-compute[75097]: No targets found.
Nov 14 16:57:23 user nova-compute[75097]: iSNS:
Nov 14 16:57:23 user nova-compute[75097]: No targets found.
Nov 14 16:57:23 user nova-compute[75097]: STATIC:
Nov 14 16:57:23 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f
Nov 14 16:57:23 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 16:57:23 user nova-compute[75097]:                 Iface Name: default
Nov 14 16:57:23 user nova-compute[75097]: FIRMWARE:
Nov 14 16:57:23 user nova-compute[75097]: No targets found.
Nov 14 16:57:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 16:57:23 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 16:57:23 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff098e-ab73-44f9-8be3-eb081bc7403e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[982cad76-dfac-40a7-bc00-6de0a6ede682]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f (non-flash)
Nov 14 16:57:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f (non-flash)
Nov 14 16:57:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafc5931fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291e485-a87c-43ee-9224-730e80d87a36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23173d3-9b68-4649-9634-2ac47bd82fbb]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0067ea7e-aa2d-408f-978f-f2acd4bc2669]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a3a7f-320f-491a-8275-445978f27406]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b15ea9b-65c5-4490-a2ea-e2f92a1901cd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d69ebf-6fb8-46aa-85fb-57c71306d719]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260]
Nov 14 16:57:23 user nova-compute[75097]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f, portal: 172.16.0.220,3260] successful.
Nov 14 16:57:23 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[681f151c-963b-4144-b650-879011ce87fd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== disconnect_volume: return (306ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:57:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'flavor' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ba99c59c-0416-4094-b125-1a0d58fae5e0 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.510s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:24 user nova-compute[75097]: INFO nova.compute.manager [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Terminating instance
Nov 14 16:57:24 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-775b6765-1bc3-4e70-bb63-2a6a74d0bb61 req-1c4a8a44-2fc2-4bee-ac8b-6bb04df044d5 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-vif-unplugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-775b6765-1bc3-4e70-bb63-2a6a74d0bb61 req-1c4a8a44-2fc2-4bee-ac8b-6bb04df044d5 service nova] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-775b6765-1bc3-4e70-bb63-2a6a74d0bb61 req-1c4a8a44-2fc2-4bee-ac8b-6bb04df044d5 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-775b6765-1bc3-4e70-bb63-2a6a74d0bb61 req-1c4a8a44-2fc2-4bee-ac8b-6bb04df044d5 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-775b6765-1bc3-4e70-bb63-2a6a74d0bb61 req-1c4a8a44-2fc2-4bee-ac8b-6bb04df044d5 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] No waiting events found dispatching network-vif-unplugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:57:24 user nova-compute[75097]: DEBUG nova.compute.manager [req-775b6765-1bc3-4e70-bb63-2a6a74d0bb61 req-1c4a8a44-2fc2-4bee-ac8b-6bb04df044d5 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-vif-unplugged-d2f5996e-4a34-48ca-8cff-425fa0a550de for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Instance destroyed successfully.
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'resources' on Instance uuid a555800c-7774-4cb3-9fa9-fa96719e93ac {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-204553264',display_name='tempest-VolumesSnapshotTestJSON-instance-204553264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-204553264',id=51,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDYbJePzwM5Ko7unuGdbv8F3wuv66nYrgLNwzMEoyVXn24ns3wYOHvwlyYNLmj8h0/Qk2/aeG2ez1aI6prrB/K/NSiZ+lInWxYcisrmy8TGtsFKIDTnMae3/IHg6o8jEA==',key_name='tempest-keypair-625769455',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e4ead12218e43c79c7965fbe4dc9f54',ramdisk_id='',reservation_id='r-vqxbyum4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-126086455',owner_user_name='tempest-VolumesSnapshotTestJSON-126086455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0f638a17d024df8b22c9d09dbac62e5',uuid=a555800c-7774-4cb3-9fa9-fa96719e93ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converting VIF {"id": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "address": "fa:16:3e:73:95:6a", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2f5996e-4a", "ovs_interfaceid": "d2f5996e-4a34-48ca-8cff-425fa0a550de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_vif [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2f5996e-4a, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cac8e326-c57d-4c0e-9495-0b187dfac25d) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:25 user nova-compute[75097]: INFO os_vif [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:95:6a,bridge_name='br-int',has_traffic_filtering=True,id=d2f5996e-4a34-48ca-8cff-425fa0a550de,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2f5996e-4a')
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:26f6905f-34e0-4604-9dea-082630dda13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCAmRByV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:57:25 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[45ed1e78-8ab9-4d2c-8885-7be8c8619ab8]: Unexpected error while running command.
Nov 14 16:57:25 user nova-compute[75097]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 16:57:25 user nova-compute[75097]: Exit code: 21
Nov 14 16:57:25 user nova-compute[75097]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 16:57:25 user nova-compute[75097]: Stderr: '' {{(pid=86343) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 14 16:57:25 user nova-compute[75097]: Traceback (most recent call last):
Nov 14 16:57:25 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 14 16:57:25 user nova-compute[75097]:     ret = func(*f_args, **f_kwargs)
Nov 14 16:57:25 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 14 16:57:25 user nova-compute[75097]:     return func(*args, **kwargs)
Nov 14 16:57:25 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 14 16:57:25 user nova-compute[75097]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 14 16:57:25 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 14 16:57:25 user nova-compute[75097]:     return putils.execute(on_execute=on_execute,
Nov 14 16:57:25 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 14 16:57:25 user nova-compute[75097]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 14 16:57:25 user nova-compute[75097]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 16:57:25 user nova-compute[75097]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 16:57:25 user nova-compute[75097]: Exit code: 21
Nov 14 16:57:25 user nova-compute[75097]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 16:57:25 user nova-compute[75097]: Stderr: ''
Nov 14 16:57:25 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed1e78-8ab9-4d2c-8885-7be8c8619ab8]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 16:57:25 user nova-compute[75097]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 16:57:25 user nova-compute[75097]: Exit code: 21
Nov 14 16:57:25 user nova-compute[75097]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 16:57:25 user nova-compute[75097]: Stderr: ''
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 14 16:57:25 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi 
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75097) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== disconnect_volume: return (27ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 16:57:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Deleting instance files /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac_del
Nov 14 16:57:25 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Deletion of /opt/stack/data/nova/instances/a555800c-7774-4cb3-9fa9-fa96719e93ac_del complete
Nov 14 16:57:25 user nova-compute[75097]: INFO nova.compute.manager [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 16:57:25 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 16:57:25 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 16:57:26 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:57:26 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Took 0.66 seconds to deallocate network for instance.
Nov 14 16:57:26 user nova-compute[75097]: WARNING nova.volume.cinder [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Attachment 7a9b27fc-0942-44c4-b1af-3dcf69cf8737 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7a9b27fc-0942-44c4-b1af-3dcf69cf8737. (HTTP 404) (Request-ID: req-e6e6259f-9ca5-4ee6-95d3-44d55da580e2)
Nov 14 16:57:26 user nova-compute[75097]: INFO nova.compute.manager [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 16:57:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:26 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:57:26 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:57:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:26 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Deleted allocations for instance a555800c-7774-4cb3-9fa9-fa96719e93ac
Nov 14 16:57:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9e1be756-412a-43e3-9a32-77a2b4ade909 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.895s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] Acquiring lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] Lock "a555800c-7774-4cb3-9fa9-fa96719e93ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] No waiting events found dispatching network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:57:27 user nova-compute[75097]: WARNING nova.compute.manager [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received unexpected event network-vif-plugged-d2f5996e-4a34-48ca-8cff-425fa0a550de for instance with vm_state deleted and task_state None.
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-135fa431-9212-49e2-9215-b0a93f501eb6 req-b8141189-f5bd-456d-930e-daa5dbca53d0 service nova] [instance: a555800c-7774-4cb3-9fa9-fa96719e93ac] Received event network-vif-deleted-d2f5996e-4a34-48ca-8cff-425fa0a550de {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:57:27 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:57:27 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9076MB free_disk=24.950008392333984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:57:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:57:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:57:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:57:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 16:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 16:57:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 16:57:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:57:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:57:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:57:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:57:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:57:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:57:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:57:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:57:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:57:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:57:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:57:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:57:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 16:58:03 user nova-compute[75097]: INFO nova.compute.claims [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Claim successful on node user
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.network.neutron [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 16:58:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.policy [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0f638a17d024df8b22c9d09dbac62e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4ead12218e43c79c7965fbe4dc9f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 16:58:03 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Creating image(s)
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "/opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "/opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:03 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk 1073741824" returned: 0 in 0.057s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Successfully created port: 841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Cannot resize image /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Ensure instance console log exists: /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Successfully updated port: 841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquired lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-changed-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.compute.manager [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Refreshing instance network info cache due to event network-changed-841f1a46-7ca2-40ce-a370-cb6ac9f8b508. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] Acquiring lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.network.neutron [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating instance_info_cache with network_info: [{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Releasing lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Instance network_info: |[{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] Acquired lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.network.neutron [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Refreshing network info cache for port 841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:58:04 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Start _get_guest_xml network_info=[{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 16:58:05 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:58:05 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1482013076',display_name='tempest-VolumesSnapshotTestJSON-instance-1482013076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1482013076',id=52,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGziPg3hvdwMunPRNI4neiwlfLhsa5d9UVHPQk0z5ZDf4wHcjZkacgjPjJ2PpLFSNzV4DbYxCOrk2hn2w7zLUMLMkzZOIXXrFd3FAJy60S06MYbKu9VYuCqZDaWQmAM0Cg==',key_name='tempest-keypair-1009309065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4ead12218e43c79c7965fbe4dc9f54',ramdisk_id='',reservation_id='r-st46d56x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-126086455',owner_user_name='tempest-VolumesSnapshotTestJSON-126086455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0f638a17d024df8b22c9d09dbac62e5',uuid=5b9d34db-c1e2-4232-a681-361877dbc2b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converting VIF {"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.objects.instance [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 16:58:05 user nova-compute[75097]:   <uuid>5b9d34db-c1e2-4232-a681-361877dbc2b0</uuid>
Nov 14 16:58:05 user nova-compute[75097]:   <name>instance-00000034</name>
Nov 14 16:58:05 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 16:58:05 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 16:58:05 user nova-compute[75097]:   <metadata>
Nov 14 16:58:05 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 16:58:05 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 16:58:05 user nova-compute[75097]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1482013076</nova:name>
Nov 14 16:58:05 user nova-compute[75097]:       <nova:creationTime>2023-11-14 16:58:05</nova:creationTime>
Nov 14 16:58:05 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 16:58:05 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 16:58:05 user nova-compute[75097]:       </nova:flavor>
Nov 14 16:58:05 user nova-compute[75097]:       <nova:owner>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:user uuid="c0f638a17d024df8b22c9d09dbac62e5">tempest-VolumesSnapshotTestJSON-126086455-project-member</nova:user>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:project uuid="4e4ead12218e43c79c7965fbe4dc9f54">tempest-VolumesSnapshotTestJSON-126086455</nova:project>
Nov 14 16:58:05 user nova-compute[75097]:       </nova:owner>
Nov 14 16:58:05 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 16:58:05 user nova-compute[75097]:       <nova:ports>
Nov 14 16:58:05 user nova-compute[75097]:         <nova:port uuid="841f1a46-7ca2-40ce-a370-cb6ac9f8b508">
Nov 14 16:58:05 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 16:58:05 user nova-compute[75097]:         </nova:port>
Nov 14 16:58:05 user nova-compute[75097]:       </nova:ports>
Nov 14 16:58:05 user nova-compute[75097]:     </nova:instance>
Nov 14 16:58:05 user nova-compute[75097]:   </metadata>
Nov 14 16:58:05 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 16:58:05 user nova-compute[75097]:     <system>
Nov 14 16:58:05 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 16:58:05 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 16:58:05 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 16:58:05 user nova-compute[75097]:       <entry name="serial">5b9d34db-c1e2-4232-a681-361877dbc2b0</entry>
Nov 14 16:58:05 user nova-compute[75097]:       <entry name="uuid">5b9d34db-c1e2-4232-a681-361877dbc2b0</entry>
Nov 14 16:58:05 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 16:58:05 user nova-compute[75097]:     </system>
Nov 14 16:58:05 user nova-compute[75097]:   </sysinfo>
Nov 14 16:58:05 user nova-compute[75097]:   <os>
Nov 14 16:58:05 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 16:58:05 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 16:58:05 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 16:58:05 user nova-compute[75097]:   </os>
Nov 14 16:58:05 user nova-compute[75097]:   <features>
Nov 14 16:58:05 user nova-compute[75097]:     <acpi/>
Nov 14 16:58:05 user nova-compute[75097]:     <apic/>
Nov 14 16:58:05 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 16:58:05 user nova-compute[75097]:   </features>
Nov 14 16:58:05 user nova-compute[75097]:   <clock offset="utc">
Nov 14 16:58:05 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 16:58:05 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 16:58:05 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 16:58:05 user nova-compute[75097]:   </clock>
Nov 14 16:58:05 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 16:58:05 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 16:58:05 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 16:58:05 user nova-compute[75097]:   </cpu>
Nov 14 16:58:05 user nova-compute[75097]:   <devices>
Nov 14 16:58:05 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 16:58:05 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 16:58:05 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk"/>
Nov 14 16:58:05 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 16:58:05 user nova-compute[75097]:     </disk>
Nov 14 16:58:05 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 16:58:05 user nova-compute[75097]:       <mac address="fa:16:3e:81:ea:5c"/>
Nov 14 16:58:05 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:58:05 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 16:58:05 user nova-compute[75097]:       <target dev="tap841f1a46-7c"/>
Nov 14 16:58:05 user nova-compute[75097]:     </interface>
Nov 14 16:58:05 user nova-compute[75097]:     <serial type="pty">
Nov 14 16:58:05 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/console.log" append="off"/>
Nov 14 16:58:05 user nova-compute[75097]:     </serial>
Nov 14 16:58:05 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 16:58:05 user nova-compute[75097]:     <video>
Nov 14 16:58:05 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 16:58:05 user nova-compute[75097]:     </video>
Nov 14 16:58:05 user nova-compute[75097]:     <rng model="virtio">
Nov 14 16:58:05 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 16:58:05 user nova-compute[75097]:     </rng>
Nov 14 16:58:05 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 16:58:05 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 16:58:05 user nova-compute[75097]:       <stats period="10"/>
Nov 14 16:58:05 user nova-compute[75097]:     </memballoon>
Nov 14 16:58:05 user nova-compute[75097]:   </devices>
Nov 14 16:58:05 user nova-compute[75097]: </domain>
Nov 14 16:58:05 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1482013076',display_name='tempest-VolumesSnapshotTestJSON-instance-1482013076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1482013076',id=52,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGziPg3hvdwMunPRNI4neiwlfLhsa5d9UVHPQk0z5ZDf4wHcjZkacgjPjJ2PpLFSNzV4DbYxCOrk2hn2w7zLUMLMkzZOIXXrFd3FAJy60S06MYbKu9VYuCqZDaWQmAM0Cg==',key_name='tempest-keypair-1009309065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e4ead12218e43c79c7965fbe4dc9f54',ramdisk_id='',reservation_id='r-st46d56x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-126086455',owner_user_name='tempest-VolumesSnapshotTestJSON-126086455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T16:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0f638a17d024df8b22c9d09dbac62e5',uuid=5b9d34db-c1e2-4232-a681-361877dbc2b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converting VIF {"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG os_vif [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f7a9b08-0ef3-51d6-a860-c1a022676b05', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841f1a46-7c, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap841f1a46-7c, col_values=(('qos', UUID('8a4df1d1-64dc-4543-9030-949116566a25')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap841f1a46-7c, col_values=(('external_ids', {'iface-id': '841f1a46-7ca2-40ce-a370-cb6ac9f8b508', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ea:5c', 'vm-uuid': '5b9d34db-c1e2-4232-a681-361877dbc2b0'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:05 user nova-compute[75097]: INFO os_vif [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c')
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No VIF found with MAC fa:16:3e:81:ea:5c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updated VIF entry in instance network info cache for port 841f1a46-7ca2-40ce-a370-cb6ac9f8b508. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG nova.network.neutron [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating instance_info_cache with network_info: [{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:58:05 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-fc482c39-d094-4b71-a798-8323e1c19aa0 req-85f8ba16-03f3-4116-bfc3-d76ef859d605 service nova] Releasing lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-22012053-4bdb-4aaf-ad5b-765f49d72e1f req-f478d800-3b40-4cd1-8a3b-e295d8ff978b service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-22012053-4bdb-4aaf-ad5b-765f49d72e1f req-f478d800-3b40-4cd1-8a3b-e295d8ff978b service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-22012053-4bdb-4aaf-ad5b-765f49d72e1f req-f478d800-3b40-4cd1-8a3b-e295d8ff978b service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-22012053-4bdb-4aaf-ad5b-765f49d72e1f req-f478d800-3b40-4cd1-8a3b-e295d8ff978b service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG nova.compute.manager [req-22012053-4bdb-4aaf-ad5b-765f49d72e1f req-f478d800-3b40-4cd1-8a3b-e295d8ff978b service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:58:06 user nova-compute[75097]: WARNING nova.compute.manager [req-22012053-4bdb-4aaf-ad5b-765f49d72e1f req-f478d800-3b40-4cd1-8a3b-e295d8ff978b service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state building and task_state spawning.
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:07 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 16:58:08 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Instance spawned successfully.
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 16:58:08 user nova-compute[75097]: INFO nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 16:58:08 user nova-compute[75097]: INFO nova.compute.manager [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Took 5.54 seconds to build instance.
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-db0dc64c-e427-4240-ae88-ccee45eec2b0 req-fc513230-56f1-4c58-82ca-cc20f6966d84 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-db0dc64c-e427-4240-ae88-ccee45eec2b0 req-fc513230-56f1-4c58-82ca-cc20f6966d84 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-db0dc64c-e427-4240-ae88-ccee45eec2b0 req-fc513230-56f1-4c58-82ca-cc20f6966d84 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-db0dc64c-e427-4240-ae88-ccee45eec2b0 req-fc513230-56f1-4c58-82ca-cc20f6966d84 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:08 user nova-compute[75097]: DEBUG nova.compute.manager [req-db0dc64c-e427-4240-ae88-ccee45eec2b0 req-fc513230-56f1-4c58-82ca-cc20f6966d84 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 16:58:08 user nova-compute[75097]: WARNING nova.compute.manager [req-db0dc64c-e427-4240-ae88-ccee45eec2b0 req-fc513230-56f1-4c58-82ca-cc20f6966d84 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state active and task_state None.
Nov 14 16:58:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-90dfe45c-192b-4f48-b86e-07fef6150c0e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.634s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:09 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:58:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:58:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=24.921817779541016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:58:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating instance_info_cache with network_info: [{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:58:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:47 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:58:47 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Triggering sync for uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 16:58:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:58:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:58:47 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:58:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:58:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:58:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:58:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:58:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:58:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:59:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:26 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:59:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:59:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.919536590576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 16:59:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating instance_info_cache with network_info: [{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 16:59:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-changed-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 16:59:54 user nova-compute[75097]: DEBUG nova.compute.manager [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Refreshing instance network info cache due to event network-changed-841f1a46-7ca2-40ce-a370-cb6ac9f8b508. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 16:59:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] Acquiring lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 16:59:54 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] Acquired lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 16:59:54 user nova-compute[75097]: DEBUG nova.network.neutron [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Refreshing network info cache for port 841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG nova.network.neutron [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updated VIF entry in instance network info cache for port 841f1a46-7ca2-40ce-a370-cb6ac9f8b508. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG nova.network.neutron [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating instance_info_cache with network_info: [{"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-91852f13-e40d-49af-ab0e-19b16a188e4e req-91ff6297-9fc3-43c9-bda5-49eb65440001 service nova] Releasing lock "refresh_cache-5b9d34db-c1e2-4232-a681-361877dbc2b0" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:59:55 user nova-compute[75097]: DEBUG nova.objects.instance [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'flavor' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 16:59:55 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Ignoring supplied device name: /dev/vdb
Nov 14 16:59:55 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 16:59:56 user nova-compute[75097]: INFO nova.compute.manager [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Attaching volume 2e827bdc-6c7b-4e58-9a3f-19394d90c577 to /dev/vdb
Nov 14 16:59:56 user nova-compute[75097]: DEBUG os_brick.utils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420be86-b499-4eea-823f-d8e014cdfb65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[037804f2-1ef9-4e32-a684-9c0f2164d71f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5243aff-4c11-43ab-a062-2d8863248447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[28169c3a-ff63-4e5a-9b7e-470090e89d7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 16:59:56 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 16:59:56 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92ced1-868c-4419-b8ea-f26c8b2739b3]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG os_brick.utils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 16:59:56 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating existing volume attachment record: 6fe67267-a700-4f0f-a0df-8e374eb4a4f9 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 16:59:57 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 16:59:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtVyUjGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:00:00 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:00:00 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:00:00 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3688c0-d1f6-462b-8416-69f666d1b722]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:00:00 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e766ab-a47c-41a1-8c8e-3815cb6f58c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577] added
Nov 14 17:00:00 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a84fe1-1969-41ea-85b4-88b3f3e0e307]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[968dc56e-1c96-492b-9e51-f40d07c571ef]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtVyUjGW {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qtVyUjGW" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1eb219-663f-4639-ac19-ef6661df57b4]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qtVyUjGW'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecfbd82-c235-494c-8925-1f2f11aab104]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[578226cf-697f-4f09-b2cf-e14a5db90729]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:00:00 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:00:00 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:00:00 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 17:00:00 user nova-compute[75097]: 
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41aa2b1-42af-4c36-acaf-511ca4e98c89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260]
Nov 14 17:00:00 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260] successful.
Nov 14 17:00:00 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b6b80-e99f-4295-b7d1-f80f46a8bbd2]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c59a0c-1735-4e74-86cd-f38a9ed53b02]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 (non-flash)
Nov 14 17:00:00 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 (non-flash)
Nov 14 17:00:00 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1e2e9-7677-4ad7-ba39-5b5aeee2d732]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:00 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtVyUjGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26165363163313832', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165363163313832', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG nova.objects.instance [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'flavor' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:00:01 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:00:01 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:00:01 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:00:01 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:00:01 user nova-compute[75097]:   <serial>2e827bdc-6c7b-4e58-9a3f-19394d90c577</serial>
Nov 14 17:00:01 user nova-compute[75097]: </disk>
Nov 14 17:00:01 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:00:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:00:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:00:02 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] No VIF found with MAC fa:16:3e:81:ea:5c, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:00:02 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-4c668636-9437-4767-a05a-88870210ade7 tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.191s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:08 user nova-compute[75097]: INFO nova.compute.manager [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Detaching volume 2e827bdc-6c7b-4e58-9a3f-19394d90c577
Nov 14 17:00:08 user nova-compute[75097]: INFO nova.virt.block_device [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Attempting to driver detach volume 2e827bdc-6c7b-4e58-9a3f-19394d90c577 from mountpoint /dev/vdb
Nov 14 17:00:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Attempting to detach device vdb from instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:00:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:00:08 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:00:08 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:00:08 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:00:08 user nova-compute[75097]:   <serial>2e827bdc-6c7b-4e58-9a3f-19394d90c577</serial>
Nov 14 17:00:08 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:00:08 user nova-compute[75097]: </disk>
Nov 14 17:00:08 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:00:08 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully detached device vdb from instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 from the persistent domain config.
Nov 14 17:00:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:00:08 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:00:08 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:00:08 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:00:08 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:00:08 user nova-compute[75097]:   <serial>2e827bdc-6c7b-4e58-9a3f-19394d90c577</serial>
Nov 14 17:00:08 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:00:08 user nova-compute[75097]: </disk>
Nov 14 17:00:08 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:00:08 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:09 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:00:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:00:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:26 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:26 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:27 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:00:28 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.918411254882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:00:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 is timed out.
Nov 14 17:00:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully detached device vdb from instance 5b9d34db-c1e2-4232-a681-361877dbc2b0 from the live domain config.
Nov 14 17:00:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtVyUjGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:00:29 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691cc06-08d6-47a5-b1db-3768e0c66839]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:00:29 user nova-compute[75097]: No targets found.
Nov 14 17:00:29 user nova-compute[75097]: iSNS:
Nov 14 17:00:29 user nova-compute[75097]: No targets found.
Nov 14 17:00:29 user nova-compute[75097]: STATIC:
Nov 14 17:00:29 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577
Nov 14 17:00:29 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:00:29 user nova-compute[75097]:                 Iface Name: default
Nov 14 17:00:29 user nova-compute[75097]: FIRMWARE:
Nov 14 17:00:29 user nova-compute[75097]: No targets found.
Nov 14 17:00:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:00:29 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:00:29 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93f025-4f0c-4789-906a-33531b7112ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1864e3f-2cb2-431c-a401-7805a429d0a6]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 (non-flash)
Nov 14 17:00:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 (non-flash)
Nov 14 17:00:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf9818f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ebd9cf-ba83-4988-9cf2-adc7f7c1b3f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bbcf6c-417b-459b-be65-6c1a016fe397]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f109c4f-3d77-48a6-a24f-9d2d46f46e19]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c0b8f4-202c-43d9-b05f-3242f772ad71]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d8d9b-0593-4c54-ad47-4ca5e55a93d3]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[49730250-094d-42b6-8755-0f0f9762ca5f]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260]
Nov 14 17:00:29 user nova-compute[75097]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577, portal: 172.16.0.220,3260] successful.
Nov 14 17:00:29 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[12deb743-cd19-4714-be2b-6934a4c26d64]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== disconnect_volume: return (275ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:00:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'flavor' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-5c648fac-834f-4b3e-b77b-ac5f4f22f96f tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.482s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:30 user nova-compute[75097]: INFO nova.compute.manager [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Terminating instance
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Instance destroyed successfully.
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lazy-loading 'resources' on Instance uuid 5b9d34db-c1e2-4232-a681-361877dbc2b0 {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T16:58:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1482013076',display_name='tempest-VolumesSnapshotTestJSON-instance-1482013076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1482013076',id=52,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGziPg3hvdwMunPRNI4neiwlfLhsa5d9UVHPQk0z5ZDf4wHcjZkacgjPjJ2PpLFSNzV4DbYxCOrk2hn2w7zLUMLMkzZOIXXrFd3FAJy60S06MYbKu9VYuCqZDaWQmAM0Cg==',key_name='tempest-keypair-1009309065',keypairs=<?>,launch_index=0,launched_at=2023-11-14T16:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e4ead12218e43c79c7965fbe4dc9f54',ramdisk_id='',reservation_id='r-st46d56x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-126086455',owner_user_name='tempest-VolumesSnapshotTestJSON-126086455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T16:58:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0f638a17d024df8b22c9d09dbac62e5',uuid=5b9d34db-c1e2-4232-a681-361877dbc2b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converting VIF {"id": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "address": "fa:16:3e:81:ea:5c", "network": {"id": "dba3d89b-5a7f-4193-b567-9638417dc8d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1513524192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e4ead12218e43c79c7965fbe4dc9f54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841f1a46-7c", "ovs_interfaceid": "841f1a46-7ca2-40ce-a370-cb6ac9f8b508", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_vif [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841f1a46-7c, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a4df1d1-64dc-4543-9030-949116566a25) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:30 user nova-compute[75097]: INFO os_vif [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ea:5c,bridge_name='br-int',has_traffic_filtering=True,id=841f1a46-7ca2-40ce-a370-cb6ac9f8b508,network=Network(dba3d89b-5a7f-4193-b567-9638417dc8d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841f1a46-7c')
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e827bdc-6c7b-4e58-9a3f-19394d90c577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qtVyUjGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:00:30 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-2911b4fa-d6db-4468-a843-06b0fd20b78c req-352e4862-3b75-4c16-84c2-4c01101683b8 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-unplugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2911b4fa-d6db-4468-a843-06b0fd20b78c req-352e4862-3b75-4c16-84c2-4c01101683b8 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2911b4fa-d6db-4468-a843-06b0fd20b78c req-352e4862-3b75-4c16-84c2-4c01101683b8 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2911b4fa-d6db-4468-a843-06b0fd20b78c req-352e4862-3b75-4c16-84c2-4c01101683b8 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-2911b4fa-d6db-4468-a843-06b0fd20b78c req-352e4862-3b75-4c16-84c2-4c01101683b8 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-unplugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.compute.manager [req-2911b4fa-d6db-4468-a843-06b0fd20b78c req-352e4862-3b75-4c16-84c2-4c01101683b8 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-unplugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[743ad7f6-c5d5-4657-b974-446d58f85dec]: Unexpected error while running command.
Nov 14 17:00:30 user nova-compute[75097]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 17:00:30 user nova-compute[75097]: Exit code: 21
Nov 14 17:00:30 user nova-compute[75097]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 17:00:30 user nova-compute[75097]: Stderr: '' {{(pid=86343) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 14 17:00:30 user nova-compute[75097]: Traceback (most recent call last):
Nov 14 17:00:30 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 14 17:00:30 user nova-compute[75097]:     ret = func(*f_args, **f_kwargs)
Nov 14 17:00:30 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 14 17:00:30 user nova-compute[75097]:     return func(*args, **kwargs)
Nov 14 17:00:30 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 14 17:00:30 user nova-compute[75097]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 14 17:00:30 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 14 17:00:30 user nova-compute[75097]:     return putils.execute(on_execute=on_execute,
Nov 14 17:00:30 user nova-compute[75097]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 14 17:00:30 user nova-compute[75097]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 14 17:00:30 user nova-compute[75097]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 17:00:30 user nova-compute[75097]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 17:00:30 user nova-compute[75097]: Exit code: 21
Nov 14 17:00:30 user nova-compute[75097]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 17:00:30 user nova-compute[75097]: Stderr: ''
Nov 14 17:00:30 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ad7f6-c5d5-4657-b974-446d58f85dec]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 17:00:30 user nova-compute[75097]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 17:00:30 user nova-compute[75097]: Exit code: 21
Nov 14 17:00:30 user nova-compute[75097]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 17:00:30 user nova-compute[75097]: Stderr: ''
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 14 17:00:30 user nova-compute[75097]: ERROR os_brick.initiator.connectors.iscsi 
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75097) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] <== disconnect_volume: return (28ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:00:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:00:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Deleting instance files /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0_del
Nov 14 17:00:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Deletion of /opt/stack/data/nova/instances/5b9d34db-c1e2-4232-a681-361877dbc2b0_del complete
Nov 14 17:00:31 user nova-compute[75097]: INFO nova.compute.manager [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 17:00:31 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Skipping network cache update for instance because it is being deleted. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:00:31 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Took 0.85 seconds to deallocate network for instance.
Nov 14 17:00:31 user nova-compute[75097]: WARNING nova.volume.cinder [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Attachment 6fe67267-a700-4f0f-a0df-8e374eb4a4f9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6fe67267-a700-4f0f-a0df-8e374eb4a4f9. (HTTP 404) (Request-ID: req-90ef43c3-0fb7-4e4a-8a44-f688561e2ffe)
Nov 14 17:00:31 user nova-compute[75097]: INFO nova.compute.manager [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 17:00:31 user nova-compute[75097]: DEBUG nova.compute.manager [req-f22c73b4-cd08-4c60-b392-59510b219dcb req-db212af0-71bf-4c97-a748-749b850144f3 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-deleted-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:32 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:00:32 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:00:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:32 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Deleted allocations for instance 5b9d34db-c1e2-4232-a681-361877dbc2b0
Nov 14 17:00:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ec81a047-c366-4386-9ad8-d628c4f2210e tempest-VolumesSnapshotTestJSON-126086455 tempest-VolumesSnapshotTestJSON-126086455-project-member] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:00:33 user nova-compute[75097]: WARNING nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state deleted and task_state None.
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:00:33 user nova-compute[75097]: WARNING nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state deleted and task_state None.
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:00:33 user nova-compute[75097]: WARNING nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state deleted and task_state None.
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-unplugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-unplugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:00:33 user nova-compute[75097]: WARNING nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-unplugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state deleted and task_state None.
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Acquiring lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] Lock "5b9d34db-c1e2-4232-a681-361877dbc2b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:00:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] No waiting events found dispatching network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:00:33 user nova-compute[75097]: WARNING nova.compute.manager [req-61556ff5-ff43-43a4-a65a-1b717e8c66da req-586ec3ac-7a2e-43be-92f2-c73e0e26f499 service nova] [instance: 5b9d34db-c1e2-4232-a681-361877dbc2b0] Received unexpected event network-vif-plugged-841f1a46-7ca2-40ce-a370-cb6ac9f8b508 for instance with vm_state deleted and task_state None.
Nov 14 17:00:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:00:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:23 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:01:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:01:29 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9094MB free_disk=24.943950653076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:01:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:01:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:01:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:01:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:01:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:01:42 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:01:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:02:01 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:06 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:11 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:12 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:16 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:21 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Starting instance... {{(pid=75097) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75097) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 17:02:22 user nova-compute[75097]: INFO nova.compute.claims [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Claim successful on node user
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Start building networks asynchronously for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Allocating IP information in the background. {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.network.neutron [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] allocate_for_instance() {{(pid=75097) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 17:02:22 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 17:02:22 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Start building block device mappings for instance. {{(pid=75097) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG nova.policy [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb3eae7a0e24712b8b7eec35c9a8732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebbab0e9f82b413c91808981911e21af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75097) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Start spawning the instance on the hypervisor. {{(pid=75097) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Creating instance directory {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 17:02:23 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Creating image(s)
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "/opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "/opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.233s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.255s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk 1073741824 {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee,backing_fmt=raw /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk 1073741824" returned: 0 in 0.068s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "a7b6cb177e19b2481fa7b98175dcb9d129c241ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b6cb177e19b2481fa7b98175dcb9d129c241ee --force-share --output=json" returned: 0 in 0.233s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk. size=1073741824 {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 17:02:23 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG nova.virt.disk.api [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Cannot resize image /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk to a smaller size. {{(pid=75097) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Created local disks {{(pid=75097) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/console.log {{(pid=75097) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:24 user nova-compute[75097]: DEBUG nova.network.neutron [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Successfully created port: e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.neutron [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Successfully updated port: e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.neutron [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Building network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-changed-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.compute.manager [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Refreshing instance network info cache due to event network-changed-e4b56357-0cd7-4142-a70e-411a2a1f877e. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.neutron [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Instance cache missing network info. {{(pid=75097) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.neutron [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Instance network_info: |[{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75097) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.neutron [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Refreshing network info cache for port e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Start _get_guest_xml network_info=[{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'image_id': '8453bef7-6457-4331-abaa-62588e201fe1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 17:02:25 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:02:25 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CPU controller missing on host. {{(pid=75097) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.host [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CPU controller found on host. {{(pid=75097) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75097) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T15:56:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T15:56:57Z,direct_url=<?>,disk_format='qcow2',id=8453bef7-6457-4331-abaa-62588e201fe1,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ec544b180a348d48d977f22b9624789',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T15:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Flavor limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Image limits 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Flavor pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Image pref 0:0:0 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75097) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Got 1 possible topologies {{(pid=75097) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.hardware [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75097) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1742164881',display_name='tempest-SnapshotDataIntegrityTests-server-1742164881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1742164881',id=53,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwahXz53+gq7DXb79Thql3phe6D8ROCd7YMMb57X6xzKJxnpMfnXyrHCg+pP9qWlzOTycMB+2FD3GKrU7cEiVCOcG2Jd0RWfNVfeLCtuqlqiEpVzUuROEHYz2Ha+7CP5g==',key_name='tempest-keypair-1773112817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebbab0e9f82b413c91808981911e21af',ramdisk_id='',reservation_id='r-f4r2zpp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1724379379',owner_user_name='tempest-SnapshotDataIntegrityTests-1724379379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb3eae7a0e24712b8b7eec35c9a8732',uuid=0dde41de-33c4-4d44-8490-7c37e6a21c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75097) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Converting VIF {"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.objects.instance [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 17:02:25 user nova-compute[75097]:   <uuid>0dde41de-33c4-4d44-8490-7c37e6a21c4e</uuid>
Nov 14 17:02:25 user nova-compute[75097]:   <name>instance-00000035</name>
Nov 14 17:02:25 user nova-compute[75097]:   <memory>524288</memory>
Nov 14 17:02:25 user nova-compute[75097]:   <vcpu>1</vcpu>
Nov 14 17:02:25 user nova-compute[75097]:   <metadata>
Nov 14 17:02:25 user nova-compute[75097]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 17:02:25 user nova-compute[75097]:       <nova:package version="0.0.0"/>
Nov 14 17:02:25 user nova-compute[75097]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1742164881</nova:name>
Nov 14 17:02:25 user nova-compute[75097]:       <nova:creationTime>2023-11-14 17:02:25</nova:creationTime>
Nov 14 17:02:25 user nova-compute[75097]:       <nova:flavor name="m1.tiny">
Nov 14 17:02:25 user nova-compute[75097]:         <nova:memory>512</nova:memory>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:disk>1</nova:disk>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:swap>0</nova:swap>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:vcpus>1</nova:vcpus>
Nov 14 17:02:25 user nova-compute[75097]:       </nova:flavor>
Nov 14 17:02:25 user nova-compute[75097]:       <nova:owner>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:user uuid="fbb3eae7a0e24712b8b7eec35c9a8732">tempest-SnapshotDataIntegrityTests-1724379379-project-member</nova:user>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:project uuid="ebbab0e9f82b413c91808981911e21af">tempest-SnapshotDataIntegrityTests-1724379379</nova:project>
Nov 14 17:02:25 user nova-compute[75097]:       </nova:owner>
Nov 14 17:02:25 user nova-compute[75097]:       <nova:root type="image" uuid="8453bef7-6457-4331-abaa-62588e201fe1"/>
Nov 14 17:02:25 user nova-compute[75097]:       <nova:ports>
Nov 14 17:02:25 user nova-compute[75097]:         <nova:port uuid="e4b56357-0cd7-4142-a70e-411a2a1f877e">
Nov 14 17:02:25 user nova-compute[75097]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 17:02:25 user nova-compute[75097]:         </nova:port>
Nov 14 17:02:25 user nova-compute[75097]:       </nova:ports>
Nov 14 17:02:25 user nova-compute[75097]:     </nova:instance>
Nov 14 17:02:25 user nova-compute[75097]:   </metadata>
Nov 14 17:02:25 user nova-compute[75097]:   <sysinfo type="smbios">
Nov 14 17:02:25 user nova-compute[75097]:     <system>
Nov 14 17:02:25 user nova-compute[75097]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 17:02:25 user nova-compute[75097]:       <entry name="product">OpenStack Nova</entry>
Nov 14 17:02:25 user nova-compute[75097]:       <entry name="version">0.0.0</entry>
Nov 14 17:02:25 user nova-compute[75097]:       <entry name="serial">0dde41de-33c4-4d44-8490-7c37e6a21c4e</entry>
Nov 14 17:02:25 user nova-compute[75097]:       <entry name="uuid">0dde41de-33c4-4d44-8490-7c37e6a21c4e</entry>
Nov 14 17:02:25 user nova-compute[75097]:       <entry name="family">Virtual Machine</entry>
Nov 14 17:02:25 user nova-compute[75097]:     </system>
Nov 14 17:02:25 user nova-compute[75097]:   </sysinfo>
Nov 14 17:02:25 user nova-compute[75097]:   <os>
Nov 14 17:02:25 user nova-compute[75097]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 17:02:25 user nova-compute[75097]:     <boot dev="hd"/>
Nov 14 17:02:25 user nova-compute[75097]:     <smbios mode="sysinfo"/>
Nov 14 17:02:25 user nova-compute[75097]:   </os>
Nov 14 17:02:25 user nova-compute[75097]:   <features>
Nov 14 17:02:25 user nova-compute[75097]:     <acpi/>
Nov 14 17:02:25 user nova-compute[75097]:     <apic/>
Nov 14 17:02:25 user nova-compute[75097]:     <vmcoreinfo/>
Nov 14 17:02:25 user nova-compute[75097]:   </features>
Nov 14 17:02:25 user nova-compute[75097]:   <clock offset="utc">
Nov 14 17:02:25 user nova-compute[75097]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 17:02:25 user nova-compute[75097]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 17:02:25 user nova-compute[75097]:     <timer name="hpet" present="no"/>
Nov 14 17:02:25 user nova-compute[75097]:   </clock>
Nov 14 17:02:25 user nova-compute[75097]:   <cpu mode="custom" match="exact">
Nov 14 17:02:25 user nova-compute[75097]:     <model>Nehalem</model>
Nov 14 17:02:25 user nova-compute[75097]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 17:02:25 user nova-compute[75097]:   </cpu>
Nov 14 17:02:25 user nova-compute[75097]:   <devices>
Nov 14 17:02:25 user nova-compute[75097]:     <disk type="file" device="disk">
Nov 14 17:02:25 user nova-compute[75097]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 17:02:25 user nova-compute[75097]:       <source file="/opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk"/>
Nov 14 17:02:25 user nova-compute[75097]:       <target dev="vda" bus="virtio"/>
Nov 14 17:02:25 user nova-compute[75097]:     </disk>
Nov 14 17:02:25 user nova-compute[75097]:     <interface type="ethernet">
Nov 14 17:02:25 user nova-compute[75097]:       <mac address="fa:16:3e:b5:70:fe"/>
Nov 14 17:02:25 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 17:02:25 user nova-compute[75097]:       <mtu size="1442"/>
Nov 14 17:02:25 user nova-compute[75097]:       <target dev="tape4b56357-0c"/>
Nov 14 17:02:25 user nova-compute[75097]:     </interface>
Nov 14 17:02:25 user nova-compute[75097]:     <serial type="pty">
Nov 14 17:02:25 user nova-compute[75097]:       <log file="/opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/console.log" append="off"/>
Nov 14 17:02:25 user nova-compute[75097]:     </serial>
Nov 14 17:02:25 user nova-compute[75097]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 17:02:25 user nova-compute[75097]:     <video>
Nov 14 17:02:25 user nova-compute[75097]:       <model type="virtio"/>
Nov 14 17:02:25 user nova-compute[75097]:     </video>
Nov 14 17:02:25 user nova-compute[75097]:     <rng model="virtio">
Nov 14 17:02:25 user nova-compute[75097]:       <backend model="random">/dev/urandom</backend>
Nov 14 17:02:25 user nova-compute[75097]:     </rng>
Nov 14 17:02:25 user nova-compute[75097]:     <controller type="usb" index="0" model="none"/>
Nov 14 17:02:25 user nova-compute[75097]:     <memballoon model="virtio">
Nov 14 17:02:25 user nova-compute[75097]:       <stats period="10"/>
Nov 14 17:02:25 user nova-compute[75097]:     </memballoon>
Nov 14 17:02:25 user nova-compute[75097]:   </devices>
Nov 14 17:02:25 user nova-compute[75097]: </domain>
Nov 14 17:02:25 user nova-compute[75097]:  {{(pid=75097) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1742164881',display_name='tempest-SnapshotDataIntegrityTests-server-1742164881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1742164881',id=53,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwahXz53+gq7DXb79Thql3phe6D8ROCd7YMMb57X6xzKJxnpMfnXyrHCg+pP9qWlzOTycMB+2FD3GKrU7cEiVCOcG2Jd0RWfNVfeLCtuqlqiEpVzUuROEHYz2Ha+7CP5g==',key_name='tempest-keypair-1773112817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebbab0e9f82b413c91808981911e21af',ramdisk_id='',reservation_id='r-f4r2zpp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1724379379',owner_user_name='tempest-SnapshotDataIntegrityTests-1724379379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T17:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb3eae7a0e24712b8b7eec35c9a8732',uuid=0dde41de-33c4-4d44-8490-7c37e6a21c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Converting VIF {"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG os_vif [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c') {{(pid=75097) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'febb43de-1d1a-5942-ad83-c1f9820839f3', '_type': 'linux-noop'}}, row=False) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b56357-0c, may_exist=True, interface_attrs={}) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4b56357-0c, col_values=(('qos', UUID('30c04ae6-11b8-4f76-ad72-1e2b76bced75')),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4b56357-0c, col_values=(('external_ids', {'iface-id': 'e4b56357-0cd7-4142-a70e-411a2a1f877e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:70:fe', 'vm-uuid': '0dde41de-33c4-4d44-8490-7c37e6a21c4e'}),), if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:25 user nova-compute[75097]: INFO os_vif [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c')
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:02:25 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No VIF found with MAC fa:16:3e:b5:70:fe, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:02:26 user nova-compute[75097]: DEBUG nova.network.neutron [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated VIF entry in instance network info cache for port e4b56357-0cd7-4142-a70e-411a2a1f877e. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:02:26 user nova-compute[75097]: DEBUG nova.network.neutron [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:02:26 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-1b9beedb-befc-4242-9570-62a3aeac2195 req-405011f3-0062-429a-9116-7d1fcd889302 service nova] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e5d0e85-6ba7-4702-bc70-ea3966a5855b req-977ec779-a94b-4a83-af1a-c3f1e60835a6 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e5d0e85-6ba7-4702-bc70-ea3966a5855b req-977ec779-a94b-4a83-af1a-c3f1e60835a6 service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e5d0e85-6ba7-4702-bc70-ea3966a5855b req-977ec779-a94b-4a83-af1a-c3f1e60835a6 service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-2e5d0e85-6ba7-4702-bc70-ea3966a5855b req-977ec779-a94b-4a83-af1a-c3f1e60835a6 service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG nova.compute.manager [req-2e5d0e85-6ba7-4702-bc70-ea3966a5855b req-977ec779-a94b-4a83-af1a-c3f1e60835a6 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:02:27 user nova-compute[75097]: WARNING nova.compute.manager [req-2e5d0e85-6ba7-4702-bc70-ea3966a5855b req-977ec779-a94b-4a83-af1a-c3f1e60835a6 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received unexpected event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with vm_state building and task_state spawning.
Nov 14 17:02:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:28 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:28 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-65c6ce3a-8a35-495b-aefd-edff9c61ca09 req-802cb34e-d415-49fc-9e91-d56484e70f0c service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-65c6ce3a-8a35-495b-aefd-edff9c61ca09 req-802cb34e-d415-49fc-9e91-d56484e70f0c service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-65c6ce3a-8a35-495b-aefd-edff9c61ca09 req-802cb34e-d415-49fc-9e91-d56484e70f0c service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-65c6ce3a-8a35-495b-aefd-edff9c61ca09 req-802cb34e-d415-49fc-9e91-d56484e70f0c service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.compute.manager [req-65c6ce3a-8a35-495b-aefd-edff9c61ca09 req-802cb34e-d415-49fc-9e91-d56484e70f0c service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:02:29 user nova-compute[75097]: WARNING nova.compute.manager [req-65c6ce3a-8a35-495b-aefd-edff9c61ca09 req-802cb34e-d415-49fc-9e91-d56484e70f0c service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received unexpected event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with vm_state building and task_state spawning.
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Instance event wait completed in 0 seconds for  {{(pid=75097) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Guest created on hypervisor {{(pid=75097) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 17:02:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Instance spawned successfully.
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Found default for hw_cdrom_bus of ide {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Found default for hw_disk_bus of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Found default for hw_input_bus of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Found default for hw_pointer_model of None {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Found default for hw_video_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Found default for hw_vif_model of virtio {{(pid=75097) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 17:02:29 user nova-compute[75097]: INFO nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 14 17:02:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Checking state {{(pid=75097) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 17:02:29 user nova-compute[75097]: INFO nova.compute.manager [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Took 7.44 seconds to build instance.
Nov 14 17:02:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-874b50b9-be98-4b61-989a-918be0a27aec tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.548s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:02:31 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:02:32 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:02:32 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=24.92801284790039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 17:02:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:02:33 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:02:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:02:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:02:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:02:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 17:02:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:37 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:02:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:52 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:02:57 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:02 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:03:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:03:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:29 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:29 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:03:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:03:32 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:03:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:03:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.89887237548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:03:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:03:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:03:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:03:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:03:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:04:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:04 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-changed-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG nova.compute.manager [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Refreshing instance network info cache due to event network-changed-e4b56357-0cd7-4142-a70e-411a2a1f877e. {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Refreshing network info cache for port e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated VIF entry in instance network info cache for port e4b56357-0cd7-4142-a70e-411a2a1f877e. {{(pid=75097) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG nova.network.neutron [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:04:13 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-5ae99f9b-af82-4a04-bb6c-46d4cdd32a06 req-1a3cb011-99fe-4386-a00b-aaa698a25a6e service nova] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG nova.objects.instance [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:04:15 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:04:15 user nova-compute[75097]: INFO nova.compute.manager [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attaching volume b962326c-7742-462d-86a5-be06ffecd344 to /dev/vdb
Nov 14 17:04:16 user nova-compute[75097]: DEBUG os_brick.utils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e0b620-2143-4a16-8835-65881429dab6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac7463-6ffa-4352-957a-64350ff51780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[019dda07-a410-4d85-9820-07f92b05f6af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ada772-4f4d-4dd6-ac15-d72b4e9463bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:04:16 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:04:16 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a33cc-bb20-4b58-ae36-a07788a1f54b]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG os_brick.utils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:04:16 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating existing volume attachment record: cc6d8eea-892f-4187-89b9-808c4bafdb5e {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:04:17 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHQPksnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:04:20 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:04:20 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:04:20 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04368d5-e121-4291-b233-1785ba7ea539]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:04:20 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d778e4f-8d7f-4cfd-b393-c3721ea7034a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344] added
Nov 14 17:04:20 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6226c2-64d1-4cde-953c-c283bae7f797]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e063343e-d048-4bef-91ae-a86d7527595d]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHQPksnT {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHQPksnT" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9bed05-03a2-478a-9b13-1facd085aa0a]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BHQPksnT'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb22e24-601e-45c9-ab53-81e44b0ca237]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2d3a0-9f44-4939-b56a-1f755a1aa4a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:04:20 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:04:20 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:04:20 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 17:04:20 user nova-compute[75097]: 
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a2cf34-172f-4518-b1e6-8afe134653f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260]
Nov 14 17:04:20 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260] successful.
Nov 14 17:04:20 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248805e-a198-4104-b4bd-2f6c8b9d6399]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f1bc19-422d-4aa5-a63f-f2ebeb235739]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 (non-flash)
Nov 14 17:04:20 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 (non-flash)
Nov 14 17:04:20 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffcf501-ac5e-4662-ae38-39f4db8ffe79]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHQPksnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:04:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:04:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23539613465343465', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:04:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613465343465', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:04:21 user nova-compute[75097]: DEBUG nova.objects.instance [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:04:21 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:04:21 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:04:21 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:04:21 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:04:21 user nova-compute[75097]:   <serial>b962326c-7742-462d-86a5-be06ffecd344</serial>
Nov 14 17:04:21 user nova-compute[75097]: </disk>
Nov 14 17:04:21 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:04:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:04:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:04:22 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No VIF found with MAC fa:16:3e:b5:70:fe, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:04:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-7f25e64b-4c97-41b7-9591-f489d68c2545 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.306s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:04:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:04:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:04:29 user nova-compute[75097]: INFO nova.compute.manager [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Detaching volume b962326c-7742-462d-86a5-be06ffecd344
Nov 14 17:04:29 user nova-compute[75097]: INFO nova.virt.block_device [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attempting to driver detach volume b962326c-7742-462d-86a5-be06ffecd344 from mountpoint /dev/vdb
Nov 14 17:04:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Attempting to detach device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:04:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:04:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:04:29 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:04:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:04:29 user nova-compute[75097]:   <serial>b962326c-7742-462d-86a5-be06ffecd344</serial>
Nov 14 17:04:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:04:29 user nova-compute[75097]: </disk>
Nov 14 17:04:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:04:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config.
Nov 14 17:04:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:04:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:04:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:04:29 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:04:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:04:29 user nova-compute[75097]:   <serial>b962326c-7742-462d-86a5-be06ffecd344</serial>
Nov 14 17:04:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:04:29 user nova-compute[75097]: </disk>
Nov 14 17:04:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:04:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:04:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:04:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:04:33 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:04:33 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=24.889869689941406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:04:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:04:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:04:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:47 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:49 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e is timed out.
Nov 14 17:04:49 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config.
Nov 14 17:04:49 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHQPksnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:04:49 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:04:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b490311-511a-40a9-9da1-c035094d5d95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:04:49 user nova-compute[75097]: No targets found.
Nov 14 17:04:49 user nova-compute[75097]: iSNS:
Nov 14 17:04:49 user nova-compute[75097]: No targets found.
Nov 14 17:04:49 user nova-compute[75097]: STATIC:
Nov 14 17:04:49 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344
Nov 14 17:04:49 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:04:49 user nova-compute[75097]:                 Iface Name: default
Nov 14 17:04:49 user nova-compute[75097]: FIRMWARE:
Nov 14 17:04:49 user nova-compute[75097]: No targets found.
Nov 14 17:04:49 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:04:49 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:04:49 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:04:49 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac0f58-880f-438e-9b68-d0f0dc5b564d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8450773-e9ee-4dc9-826e-60c8382b6ad5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 (non-flash)
Nov 14 17:04:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 (non-flash)
Nov 14 17:04:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fafc48244c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d0f94d-5849-4ee4-a9ba-ab0eeb424a6a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277de23-8233-44cb-8949-e81b901c2617]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c8587-ae20-44e1-a8a8-529796b8e5c8]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5887787-2bc0-4d7f-89ba-0193c1b77d38]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea8337-3910-4f75-a743-61e442bc85e0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0241d51-252f-4e7d-959c-d4608a76f375]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260]
Nov 14 17:04:50 user nova-compute[75097]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344, portal: 172.16.0.220,3260] successful.
Nov 14 17:04:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b962326c-7742-462d-86a5-be06ffecd344 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e013782-8027-4716-bec4-f15468922edf]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== disconnect_volume: return (268ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG nova.objects.instance [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:04:50 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-1d71cbc1-c3f9-42bd-ab7b-c4415c03baeb tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.556s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:04:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:05:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG nova.objects.instance [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:05:21 user nova-compute[75097]: INFO nova.compute.manager [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attaching volume dd81ff57-ed05-41ab-8887-4a33c0416bcd to /dev/vdb
Nov 14 17:05:21 user nova-compute[75097]: DEBUG os_brick.utils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[78268c3e-87b5-4566-baba-dda88d84723f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f7c707-08a2-4402-90d0-2f442b0093da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f1737-0263-45f0-b09b-999af2b01ac7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bafff5-8156-4e8f-9d9a-efd214524788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:05:21 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:05:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc805b-da29-4b93-98f6-4bc282d0a36f]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG os_brick.utils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:05:21 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating existing volume attachment record: 6f0ea32d-a0fd-4b59-8ee7-42b773fbd328 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:05:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJLtAPwd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:05:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:05:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:05:26 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7cc9f2-05a0-4c55-8445-573a35c26c7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:05:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b544e-a7f8-4e41-800d-2ee16e728eac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd] added
Nov 14 17:05:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[778a4cbd-780e-4a3a-8dc7-2429640e85b9]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93004df-b17e-4ab7-9da4-d4f685fd2f5c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJLtAPwd {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJLtAPwd" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f3fe0e-e5e1-4d31-89bc-4effdb8fc89f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJLtAPwd'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[207fa368-2b91-4cda-a9c1-c6ac0937d7e0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[de547dbb-e092-43e6-8f00-a6005d35d8aa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:05:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:05:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:05:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 17:05:26 user nova-compute[75097]: 
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[33deb1e0-e16e-4289-9d7d-b0a073cc7b73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260]
Nov 14 17:05:26 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260] successful.
Nov 14 17:05:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2660ded-31fc-4884-82d2-e770849360b0]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[09691478-37b6-4398-a2ef-d34e947edcfe]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd (non-flash)
Nov 14 17:05:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd (non-flash)
Nov 14 17:05:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[15abf972-bd02-40d2-8857-a30208480f31]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJLtAPwd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '26665383939323063', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665383939323063', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:05:27 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:05:27 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:05:27 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:05:27 user nova-compute[75097]:   <serial>dd81ff57-ed05-41ab-8887-4a33c0416bcd</serial>
Nov 14 17:05:27 user nova-compute[75097]: </disk>
Nov 14 17:05:27 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No VIF found with MAC fa:16:3e:b5:70:fe, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:05:27 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91c41f0b-98d5-4ad7-9f38-b022fcee850f tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.235s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:05:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:05:29 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:05:29 user nova-compute[75097]: INFO nova.compute.manager [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Detaching volume dd81ff57-ed05-41ab-8887-4a33c0416bcd
Nov 14 17:05:29 user nova-compute[75097]: INFO nova.virt.block_device [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attempting to driver detach volume dd81ff57-ed05-41ab-8887-4a33c0416bcd from mountpoint /dev/vdb
Nov 14 17:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Attempting to detach device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:05:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:05:29 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:05:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:05:29 user nova-compute[75097]:   <serial>dd81ff57-ed05-41ab-8887-4a33c0416bcd</serial>
Nov 14 17:05:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:05:29 user nova-compute[75097]: </disk>
Nov 14 17:05:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:05:29 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config.
Nov 14 17:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:05:29 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:05:29 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:05:29 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:05:29 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:05:29 user nova-compute[75097]:   <serial>dd81ff57-ed05-41ab-8887-4a33c0416bcd</serial>
Nov 14 17:05:29 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:05:29 user nova-compute[75097]: </disk>
Nov 14 17:05:29 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:05:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:05:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:05:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:35 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:05:35 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=24.888839721679688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:05:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:05:36 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:05:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:05:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e is timed out.
Nov 14 17:05:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config.
Nov 14 17:05:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJLtAPwd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:05:50 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8420641-3324-4f6d-8dff-461058881ef2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:05:50 user nova-compute[75097]: No targets found.
Nov 14 17:05:50 user nova-compute[75097]: iSNS:
Nov 14 17:05:50 user nova-compute[75097]: No targets found.
Nov 14 17:05:50 user nova-compute[75097]: STATIC:
Nov 14 17:05:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd
Nov 14 17:05:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:05:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 17:05:50 user nova-compute[75097]: FIRMWARE:
Nov 14 17:05:50 user nova-compute[75097]: No targets found.
Nov 14 17:05:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:05:50 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:05:50 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba3036-06c9-4bee-870c-88f849ade0dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f60781-523b-4aef-9ac7-7f6c70c4bdc8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd (non-flash)
Nov 14 17:05:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd (non-flash)
Nov 14 17:05:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf984aacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b878c5a-e351-4515-9bc7-ffddbac54509]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae320f6-b3fd-4de3-aa08-a6a7b927b709]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d3c227-0503-4f20-80fe-5f241a0dec10]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb645cf7-fa41-48fc-873c-fd9f369ceea4]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[be842f15-8d54-4c6a-a54b-b94a904215cb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[78991be7-bc63-4f7a-b51d-3205d79bd955]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260]
Nov 14 17:05:50 user nova-compute[75097]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd, portal: 172.16.0.220,3260] successful.
Nov 14 17:05:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81ff57-ed05-41ab-8887-4a33c0416bcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5fc71b-a763-42d2-baff-bf7c18b43abd]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== disconnect_volume: return (286ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:05:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:05:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:05:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-cf08236c-4207-4514-a282-b505023f2697 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:05:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:08 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:06:21 user nova-compute[75097]: INFO nova.compute.manager [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attaching volume 9db05224-3e8b-48d4-ac07-9989db26eee3 to /dev/vdb
Nov 14 17:06:21 user nova-compute[75097]: DEBUG os_brick.utils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f60cc-00cc-438d-9c93-62b8106b80a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:21 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e08f7-d5f6-406a-abbd-702ad509ad53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747f4d4-30a2-492d-845c-c7cedc0be5c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[35061e9c-e195-4669-8901-70fdba245eaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:06:22 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:06:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9afba1-c9b9-4267-9007-91ba53cdb084]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG os_brick.utils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating existing volume attachment record: 52455dea-14e6-4088-b416-c21ae2d52283 {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:06:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAKPmpQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:06:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:06:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:06:26 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c441ebe7-afb3-4d22-95fc-e06e0b8f11f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:06:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e839dd1b-667a-40f0-ae2d-687fd7c6c6f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3] added
Nov 14 17:06:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdda442-9896-4dea-9880-616e063d8b43]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[313490b8-68c3-4aac-976c-5ae1e3823b8c]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAKPmpQy {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAKPmpQy" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[03efeab0-5615-4a3d-8e1e-b8a29ba6533e]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAKPmpQy'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[155300ed-c230-4443-bc2e-f84be167b0d6]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c50a5d7-72d0-40a6-b1a7-628dfb99eca1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:06:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:06:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:06:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 17:06:26 user nova-compute[75097]: 
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[09509357-84c5-4230-a099-038f8cdaf0a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260]
Nov 14 17:06:26 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260] successful.
Nov 14 17:06:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737162e-8b66-41f4-b34e-ce0c3a975969]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e060dc2-8c36-421f-b0c5-571d25d4482b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 (non-flash)
Nov 14 17:06:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 (non-flash)
Nov 14 17:06:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ab1406-2f9b-498d-8738-ac7aaf490f72]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:06:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAKPmpQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23066633732323933', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066633732323933', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:06:27 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:06:27 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:06:27 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:06:27 user nova-compute[75097]:   <serial>9db05224-3e8b-48d4-ac07-9989db26eee3</serial>
Nov 14 17:06:27 user nova-compute[75097]: </disk>
Nov 14 17:06:27 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:06:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No VIF found with MAC fa:16:3e:b5:70:fe, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:06:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-3c7592ff-2988-4bba-aa50-b8fd7d923620 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.180s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:06:30 user nova-compute[75097]: INFO nova.compute.manager [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Detaching volume 9db05224-3e8b-48d4-ac07-9989db26eee3
Nov 14 17:06:30 user nova-compute[75097]: INFO nova.virt.block_device [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attempting to driver detach volume 9db05224-3e8b-48d4-ac07-9989db26eee3 from mountpoint /dev/vdb
Nov 14 17:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Attempting to detach device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:06:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:06:30 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:06:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:06:30 user nova-compute[75097]:   <serial>9db05224-3e8b-48d4-ac07-9989db26eee3</serial>
Nov 14 17:06:30 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:06:30 user nova-compute[75097]: </disk>
Nov 14 17:06:30 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:06:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config.
Nov 14 17:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:06:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:06:30 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:06:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:06:30 user nova-compute[75097]:   <serial>9db05224-3e8b-48d4-ac07-9989db26eee3</serial>
Nov 14 17:06:30 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:06:30 user nova-compute[75097]: </disk>
Nov 14 17:06:30 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:06:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:34 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:35 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:06:35 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.887828826904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:06:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:06:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:06:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:06:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:50 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e is timed out.
Nov 14 17:06:50 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config.
Nov 14 17:06:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAKPmpQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:06:50 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f0123-d00a-4c36-8e62-452663f5cab2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:06:50 user nova-compute[75097]: No targets found.
Nov 14 17:06:50 user nova-compute[75097]: iSNS:
Nov 14 17:06:50 user nova-compute[75097]: No targets found.
Nov 14 17:06:50 user nova-compute[75097]: STATIC:
Nov 14 17:06:50 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3
Nov 14 17:06:50 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:06:50 user nova-compute[75097]:                 Iface Name: default
Nov 14 17:06:50 user nova-compute[75097]: FIRMWARE:
Nov 14 17:06:50 user nova-compute[75097]: No targets found.
Nov 14 17:06:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:06:50 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:06:50 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[48500b41-faf9-461e-9dfc-70d79d853062]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[87567cec-86fd-45a1-ae38-cd958a18c7f5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 (non-flash)
Nov 14 17:06:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 (non-flash)
Nov 14 17:06:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf786fd870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d4f91b-3886-4337-ba5e-24444f9bd4d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e1aa13-1fe2-43fb-b2db-e9c1bc251f3a]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[43689433-0e74-457c-a3a9-68a87fcfc6cb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827c21e-7514-412b-b71a-e31f7f07ed84]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b4ce0-1fe5-4646-a480-95b6030a2369]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[567d0280-06ad-4c91-b5ab-4c9b5c5ce64e]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260]
Nov 14 17:06:50 user nova-compute[75097]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3, portal: 172.16.0.220,3260] successful.
Nov 14 17:06:50 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db05224-3e8b-48d4-ac07-9989db26eee3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ae24af-3805-489d-b7ee-2906c30bf6ca]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== disconnect_volume: return (261ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:06:50 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:06:51 user nova-compute[75097]: DEBUG nova.objects.instance [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:06:51 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-10edd983-f99e-415b-9411-8c6967f0b179 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:06:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:06:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:06:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:06:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:06:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:07:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:07:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG nova.objects.instance [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:07:22 user nova-compute[75097]: INFO nova.compute.manager [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attaching volume b8908c9e-50df-4df4-be83-017563e6b2f5 to /dev/vdb
Nov 14 17:07:22 user nova-compute[75097]: DEBUG os_brick.utils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[4045296f-aa99-4e37-b74b-899d3967285f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:17c9a36c7bbd\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[2939bab9-07e6-4715-8ca9-a8c307e343e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d166d9b-4e7b-4246-83ab-ea3c0cf71575]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d18571-d963-4c1d-8fe6-4f0e0e67e359]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Running cmd (subprocess): nvme version {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] 'nvme version' failed. Not Retrying. {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] nvme not present on system {{(pid=75097) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 17:07:22 user nova-compute[75097]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 17:07:22 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[480333a2-f34b-4741-9070-0fdca14729c4]: (4, '') {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75097) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.lightos [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] LIGHTOS: no hostnqn found. {{(pid=75097) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG os_brick.utils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:17c9a36c7bbd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG nova.virt.block_device [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating existing volume attachment record: 42626ecc-0f50-4f62-a930-bdd774fa9a1c {{(pid=75097) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 17:07:22 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Calling os-brick to attach iSCSI Volume {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpIBxWfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:07:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:07:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:07:26 user nova-compute[75097]: INFO os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ebd70-f00d-4dcc-8786-ab84e160c39b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 17:07:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[03370f03-70bc-43b7-8b41-57b2b68a0201]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5] added\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5] added
Nov 14 17:07:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38980c5-d231-4b32-8133-9ffa644b2e2f]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[10324743-4adc-4937-b930-995eb12e8c96]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dpIBxWfg {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dpIBxWfg" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160334a-454d-4e99-986a-568f168f598b]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dpIBxWfg'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d64fe-ec37-4b4a-8bb5-252175081d05]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[653ca5ed-09c3-4bb4-b269-e9cf6d1e939c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:07:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 17:07:26 user nova-compute[75097]:  {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:07:26 user nova-compute[75097]: WARNING os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 17:07:26 user nova-compute[75097]: 
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --login {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[026687a9-64f7-42e0-a29a-a7e5a90aea3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260]
Nov 14 17:07:26 user nova-compute[75097]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260] successful.
Nov 14 17:07:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f4c97b-9b91-4778-8d9f-3e0331cc9116]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7804e23f-3903-421a-90a3-30d06df51156]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 (non-flash)
Nov 14 17:07:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 (non-flash)
Nov 14 17:07:26 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to 172.16.0.220:3260 {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75097) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75097) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d232c5-410e-4fb2-924a-0fe087600873]: (4, ('- - 0', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75097) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 17:07:26 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpIBxWfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75097) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 17:07:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:07:27 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26561333133623438', 'path': '/dev/sdb'} {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:07:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561333133623438', 'path': '/dev/sdb'} {{(pid=75097) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 17:07:27 user nova-compute[75097]: DEBUG nova.objects.instance [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:07:27 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 17:07:27 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:07:27 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:07:27 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:07:27 user nova-compute[75097]:   <serial>b8908c9e-50df-4df4-be83-017563e6b2f5</serial>
Nov 14 17:07:27 user nova-compute[75097]: </disk>
Nov 14 17:07:27 user nova-compute[75097]:  {{(pid=75097) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 17:07:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:07:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75097) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 17:07:28 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] No VIF found with MAC fa:16:3e:b5:70:fe, not building metadata {{(pid=75097) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 17:07:28 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-91566d98-bca2-44eb-8f4d-f66cbb1f42b5 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.258s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:07:30 user nova-compute[75097]: INFO nova.compute.manager [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Detaching volume b8908c9e-50df-4df4-be83-017563e6b2f5
Nov 14 17:07:30 user nova-compute[75097]: INFO nova.virt.block_device [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Attempting to driver detach volume b8908c9e-50df-4df4-be83-017563e6b2f5 from mountpoint /dev/vdb
Nov 14 17:07:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Attempting to detach device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config. {{(pid=75097) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:07:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:07:30 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:07:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:07:30 user nova-compute[75097]:   <serial>b8908c9e-50df-4df4-be83-017563e6b2f5</serial>
Nov 14 17:07:30 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:07:30 user nova-compute[75097]: </disk>
Nov 14 17:07:30 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:07:30 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the persistent domain config.
Nov 14 17:07:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config. {{(pid=75097) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG nova.virt.libvirt.guest [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 17:07:30 user nova-compute[75097]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 17:07:30 user nova-compute[75097]:   <source dev="/dev/sdb"/>
Nov 14 17:07:30 user nova-compute[75097]:   <target dev="vdb" bus="virtio"/>
Nov 14 17:07:30 user nova-compute[75097]:   <serial>b8908c9e-50df-4df4-be83-017563e6b2f5</serial>
Nov 14 17:07:30 user nova-compute[75097]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 17:07:30 user nova-compute[75097]: </disk>
Nov 14 17:07:30 user nova-compute[75097]:  {{(pid=75097) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:07:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:31 user nova-compute[75097]: DEBUG nova.virt.libvirt.driver [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 17:07:32 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:35 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:35 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75097) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 17:07:35 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:36 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75097) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:37 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:07:37 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.886913299560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75097) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:07:37 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquired lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Forcefully refreshing network info cache for instance {{(pid=75097) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG nova.objects.instance [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lazy-loading 'info_cache' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG nova.network.neutron [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [{"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Releasing lock "refresh_cache-0dde41de-33c4-4d44-8490-7c37e6a21c4e" {{(pid=75097) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 17:07:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updated the network info_cache for instance {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 17:07:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:39 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Cleaning up deleted instances {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 17:07:39 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] There are 0 instances to clean {{(pid=75097) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:07:40 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:07:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:07:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:07:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:07:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:07:45 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:50 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:07:51 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e is timed out.
Nov 14 17:07:51 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully detached device vdb from instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e from the live domain config.
Nov 14 17:07:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] calling os-brick to detach iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faf98414ee0>, {'target_iqn': 'iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpIBxWfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 17:07:51 user nova-compute[75097]: WARNING os_brick.initiator.connectors.base [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[50732994-8ed3-49e0-bb44-a1a58fe06d7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 17:07:51 user nova-compute[75097]: No targets found.
Nov 14 17:07:51 user nova-compute[75097]: iSNS:
Nov 14 17:07:51 user nova-compute[75097]: No targets found.
Nov 14 17:07:51 user nova-compute[75097]: STATIC:
Nov 14 17:07:51 user nova-compute[75097]: Target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5
Nov 14 17:07:51 user nova-compute[75097]:         Portal: 172.16.0.220:3260,-1
Nov 14 17:07:51 user nova-compute[75097]:                 Iface Name: default
Nov 14 17:07:51 user nova-compute[75097]: FIRMWARE:
Nov 14 17:07:51 user nova-compute[75097]: No targets found.
Nov 14 17:07:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 17:07:51 user nova-compute[75097]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 17:07:51 user nova-compute[75097]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75097) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5', 0)] {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bb12f3-b6b2-4247-b8bf-2e91818eb509]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[23095fe1-dd9e-4edb-aefd-2cd3eebd03d1]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 (non-flash)\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 (non-flash)
Nov 14 17:07:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 (non-flash)
Nov 14 17:07:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faf78510af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5'): ({'sdb'}, set())}) {{(pid=75097) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Removing single pathed devices sdb {{(pid=75097) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e470453-1f24-4b59-8067-9c3e9888fef2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca483dd9-677d-4a24-8c69-ccd3b86fe163]: (4, ('ok\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Flushing IO for device /dev/sdb {{(pid=75097) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce8545-f2a5-4d87-9308-f905fc08a9eb]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75097) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10972ef-073c-4325-8a55-378283fe9f5e]: (4, ('1', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.linuxscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] SCSI volumes sdb have been removed. {{(pid=75097) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5')] {{(pid=75097) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff0229-a530-4a26-a5c7-0d8d562a3613]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --logout {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a529dcc-b6ff-4eef-9a30-a76e204bdd84]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260]
Nov 14 17:07:51 user nova-compute[75097]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5, portal: 172.16.0.220,3260] successful.
Nov 14 17:07:51 user nova-compute[75097]:  stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op delete {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8908c9e-50df-4df4-be83-017563e6b2f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86343) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db9510d-e32a-4ae7-a793-b2834d1b8f99]: (4, ('', '')) {{(pid=86343) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75097) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.base [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] <== disconnect_volume: return (293ms) None {{(pid=75097) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 17:07:51 user nova-compute[75097]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Disconnected iSCSI Volume {{(pid=75097) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 17:07:52 user nova-compute[75097]: DEBUG nova.objects.instance [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'flavor' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:07:52 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-ad896680-4520-4690-9f6d-7d4dbbed0a37 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:07:55 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:08:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:08:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:08:00 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:08:05 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:10 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:11 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75097) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 17:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75097) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 17:08:15 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:20 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:25 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:33 user nova-compute[75097]: INFO nova.compute.manager [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Terminating instance
Nov 14 17:08:33 user nova-compute[75097]: DEBUG nova.compute.manager [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Start destroying the instance on the hypervisor. {{(pid=75097) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c739a07-9d7d-4648-951e-7090a2490d0e req-1c804c5a-7a42-4d42-acb1-de2e50311325 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-unplugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c739a07-9d7d-4648-951e-7090a2490d0e req-1c804c5a-7a42-4d42-acb1-de2e50311325 service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c739a07-9d7d-4648-951e-7090a2490d0e req-1c804c5a-7a42-4d42-acb1-de2e50311325 service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-0c739a07-9d7d-4648-951e-7090a2490d0e req-1c804c5a-7a42-4d42-acb1-de2e50311325 service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c739a07-9d7d-4648-951e-7090a2490d0e req-1c804c5a-7a42-4d42-acb1-de2e50311325 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-unplugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:08:33 user nova-compute[75097]: DEBUG nova.compute.manager [req-0c739a07-9d7d-4648-951e-7090a2490d0e req-1c804c5a-7a42-4d42-acb1-de2e50311325 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-unplugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with task_state deleting. {{(pid=75097) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [-] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Instance destroyed successfully.
Nov 14 17:08:34 user nova-compute[75097]: DEBUG nova.objects.instance [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lazy-loading 'resources' on Instance uuid 0dde41de-33c4-4d44-8490-7c37e6a21c4e {{(pid=75097) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG nova.virt.libvirt.vif [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T17:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1742164881',display_name='tempest-SnapshotDataIntegrityTests-server-1742164881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1742164881',id=53,image_ref='8453bef7-6457-4331-abaa-62588e201fe1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwahXz53+gq7DXb79Thql3phe6D8ROCd7YMMb57X6xzKJxnpMfnXyrHCg+pP9qWlzOTycMB+2FD3GKrU7cEiVCOcG2Jd0RWfNVfeLCtuqlqiEpVzUuROEHYz2Ha+7CP5g==',key_name='tempest-keypair-1773112817',keypairs=<?>,launch_index=0,launched_at=2023-11-14T17:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebbab0e9f82b413c91808981911e21af',ramdisk_id='',reservation_id='r-f4r2zpp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8453bef7-6457-4331-abaa-62588e201fe1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1724379379',owner_user_name='tempest-SnapshotDataIntegrityTests-1724379379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T17:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb3eae7a0e24712b8b7eec35c9a8732',uuid=0dde41de-33c4-4d44-8490-7c37e6a21c4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Converting VIF {"id": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "address": "fa:16:3e:b5:70:fe", "network": {"id": "33882a52-9524-4074-9b3d-4c385209b999", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1564791257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebbab0e9f82b413c91808981911e21af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b56357-0c", "ovs_interfaceid": "e4b56357-0cd7-4142-a70e-411a2a1f877e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG nova.network.os_vif_util [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c') {{(pid=75097) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG os_vif [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c') {{(pid=75097) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b56357-0c, bridge=br-int, if_exists=True) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30c04ae6-11b8-4f76-ad72-1e2b76bced75) {{(pid=75097) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:34 user nova-compute[75097]: INFO os_vif [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:70:fe,bridge_name='br-int',has_traffic_filtering=True,id=e4b56357-0cd7-4142-a70e-411a2a1f877e,network=Network(33882a52-9524-4074-9b3d-4c385209b999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4b56357-0c')
Nov 14 17:08:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Deleting instance files /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e_del
Nov 14 17:08:34 user nova-compute[75097]: INFO nova.virt.libvirt.driver [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Deletion of /opt/stack/data/nova/instances/0dde41de-33c4-4d44-8490-7c37e6a21c4e_del complete
Nov 14 17:08:34 user nova-compute[75097]: INFO nova.compute.manager [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 17:08:34 user nova-compute[75097]: DEBUG oslo.service.loopingcall [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75097) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG nova.compute.manager [-] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Deallocating network for instance {{(pid=75097) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] deallocate_for_instance() {{(pid=75097) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.network.neutron [-] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Updating instance_info_cache with network_info: [] {{(pid=75097) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 17:08:35 user nova-compute[75097]: INFO nova.compute.manager [-] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Took 0.77 seconds to deallocate network for instance.
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Refreshing inventories for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Updating ProviderTree inventory for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Updating inventory in ProviderTree for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-bac8dca0-eb8d-49ce-9642-3c3731c912d7 req-c388835f-2247-4ea1-9cf7-958266f46d10 service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-deleted-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Refreshing aggregate associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, aggregates: None {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Refreshing trait associations for resource provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=75097) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:35 user nova-compute[75097]: INFO nova.scheduler.client.report [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Deleted allocations for instance 0dde41de-33c4-4d44-8490-7c37e6a21c4e
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-31d06e60-d694-48e8-9a93-6a2be5e68e72 tempest-SnapshotDataIntegrityTests-1724379379 tempest-SnapshotDataIntegrityTests-1724379379-project-member] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:08:35 user nova-compute[75097]: WARNING nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received unexpected event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with vm_state deleted and task_state None.
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:08:35 user nova-compute[75097]: WARNING nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received unexpected event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with vm_state deleted and task_state None.
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:08:35 user nova-compute[75097]: WARNING nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received unexpected event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with vm_state deleted and task_state None.
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Acquiring lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] Lock "0dde41de-33c4-4d44-8490-7c37e6a21c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:35 user nova-compute[75097]: DEBUG nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] No waiting events found dispatching network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e {{(pid=75097) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 17:08:35 user nova-compute[75097]: WARNING nova.compute.manager [req-9d6f93b3-2c97-48b0-9637-892f16cc33dd req-b40b872d-5baa-47ca-a0a5-94c44ccd591d service nova] [instance: 0dde41de-33c4-4d44-8490-7c37e6a21c4e] Received unexpected event network-vif-plugged-e4b56357-0cd7-4142-a70e-411a2a1f877e for instance with vm_state deleted and task_state None.
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:08:36 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:08:36 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.913925170898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:08:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:08:37 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:08:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:08:37 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:08:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:40 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:44 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:08:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:08:54 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:08:59 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:09:04 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:09:09 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:09:14 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:15 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:19 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 17:09:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:24 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:27 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:29 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:30 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:32 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:32 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75097) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 17:09:34 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Auditing locally available compute resources for user (node: user) {{(pid=75097) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 17:09:36 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:09:36 user nova-compute[75097]: WARNING nova.virt.libvirt.driver [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=24.912853240966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75097) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75097) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.compute.provider_tree [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed in ProviderTree for provider: 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 {{(pid=75097) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.scheduler.client.report [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Inventory has not changed for provider 321f3c0d-b8ec-4f98-bbbb-009e84ae5816 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75097) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG nova.compute.resource_tracker [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Compute_service record updated for user:user {{(pid=75097) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 17:09:36 user nova-compute[75097]: DEBUG oslo_concurrency.lockutils [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75097) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 17:09:38 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Starting heal instance info cache {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 17:09:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Rebuilding the list of instances to heal {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 17:09:38 user nova-compute[75097]: DEBUG nova.compute.manager [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Didn't find any instances for network info cache update. {{(pid=75097) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 17:09:39 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:41 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:42 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:43 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:44 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 17:09:45 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:46 user nova-compute[75097]: DEBUG oslo_service.periodic_task [None req-9754962d-6052-4257-bea0-a8ccdb137c10 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75097) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 17:09:49 user nova-compute[75097]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75097) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}